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RECORDING MEDIUM, REPRODUCTION DEVICE, PROGRAM , AND 

REPRODUCTION METHOD 

5 Technical Field 
[0001] 

The present invention relates to a playback technique 
of digitized movies. More particularly, the present 
invention relates to an improvement made on incorporation 
10 of the playback technique into a recording medium, such 
as a BD-ROM, and a playback device. 

Background Art 
[0002] ~~ 

15 Today, movies in digitized form are dominant and yet 

movie-distributing companies spend great expense for 
advertising their movies to viewers. In other words, in 
order to gain wide publicity for some kind of information, 
it is required to invest a considerable amount of advertising 

20 expense to mass media. In the case of movie distribution 
via recording media, it is a common practice that the 
recording media stores, in addition to a main feature movie, 
a preview of another movie generally called a "trailer" 
for users to watch. . 

25 [0003] 

The patent literature 1 listed below discloses a 
technique for prohibiting trick play, such as 
fast-forwarding, during playback of the main feature and 
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the advertising video in order to ensure viewing of the 
advertisement video ,by the users. 

Patent Literature 1: PCT publication No. WO 97/07511 

5 Disclosure of the Invention 

Problems the Invention is attempting to Solve 
[0004] 

However, the following point should be noted in users 
point of view. Different from broadcasting, which is 

10 generally supplied free of charge and presented with 
advertisement of the broadcasting sponsors, the users of 
a disc medium pay an adequate price to view the disc content . 
The prior , art technique disclosed in the above patent 
literature is an attempt to force viewing of advertisement 

15 to the users who have paid a reasonable price. Such 
arrangement may be offensive to some users and may create 
an opposite effect of keeping such users away from purchasing 
the advertised products. 
[0005] 

20 The present invention aims to provide a recording 

medium used for conveying some kind of information to widely 
to users, without harming the relationship with the users. 

Means for Solving the Problems 
25 [0006] 

In an attempt to achieve the above aim, the present 
invention provides a recording medium having recorded 
thereon a video stream and copy control information. The 
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video stream contains video composed of a plurality of frame 
images. The copy control information defines different 
restrictions on recording of a video signal that is converted 
from the frame images. The restrictions differ depending 
5 on whether the video signal is output with or without addition 
of supplemental information. 

Effects of the Invention 
[0007] 

10 With the above structure, on condition that a video 

signal is output with addition of supplemental information, 
copy control information indicating that the movie carried 
by the video signal is permitted to be recorded. That is, 
by accepting that the supplemental information is added, 

15 users are permitted to freely copy a digitized movie film. 

Such a copy of the movie may be stored on a HD recorder 
or home server. Playback of the copy is presented with 
the supplemental information. Thus, whenever watching the 
movie, the users have no choice but to watch playback with 

20 the supplemental information added thereto. Consequently, 
a certain level of advertising effect is expected. 
[0008] 

Since the users are offered the right to make personal 
copies of a movie in exchange for watching supplemental 
25 information, this form of advertising works with the users' 
consent. In other words, since the users are offered the 
choices as to whether or not to accept such advertising 
via a copy of original content, the advertising effect can 
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be increased without offending the users. 

This form of advertising is implemented through the 
processing performed by the playback device for generating 
a copy containing pictures attached the supplemental 
information. In other words, this form of advertising is 
not possible without actively making various arrangements 
to the playback device. In view of the time and effort 
taken to make such arrangements, the makers of playback 
devices have the right to ask the film-production company 
for reward for the advertising effect achieved. 
[0009] 

The advertising revenue would encourage the makers 
for further revitalization of research and development. 

Note that the scope of "supplemental information 7 ' 
covers not only advertisement but also information other 
than advertisement. For example, images and audio 
representing private messages or slogans may be the content 
of supplemental information. In addition, the 

advertisement or commercial messages include any form of 
information (including video and/or audio) for announcing 
products, events, organizations, and groups (including 
public and commercial institutions) widely to the public. 
[0010] 

The content of additional information may be an opinion 
of an individual or a slogan of a national or local government 
reading, for example, "Clean Your Neighborhood". The" 
present invention achieves a significant effect that such 
an opinion and slogan are conveyed widely to the public 



via copies of copyrighted material. 

Brief Description Of The Drawings 
[0011] 

5 Fig . 1 illustrates a form of using the recording medium 

according to the present invention; 

Fig. 2 illustrates the structure of a BD-ROM that is 
a. recording media according to the present invention; 

Fig. 3 illustrates the structure of an application 
10 layer the recording medium according to the present 
invention; 

Fig. 4A illustrates the internal structure of BD.CCI; 
[0012] 

Fig. 4B illustrates one possible setting of CCIforHD 
15 and CCIforSD; 

Fig. 4C illustrates an example in which different 
levels of restrictions are imposed on recording of a video 
signal; 

Fig. 5 schematically illustrates the structure of a 
20 file with the extension ".M2TS"; 

Fig. 6 illustrates the internal structure of Clip 
information; 

Fig. 7 illustrates the structure of PL information; 
Fig. 8 illustrates the relationship between an AV clip 
25 and PlayList information; 

Fig. 9 illustrates a playback section defined on a 
SubClip timeline and control defined for synchronous 
. playback of the playback section; 
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Fig. 10 illustrates the internal structure of a 
playback device according to the present invention; 

Fig. 11 illustrates the internal structure of a signal 
output unit 28; 

Fig. 12A illustrates an HD video output signal; 
[0013] 

Fig. 12B illustrates conversion through a 2:3 pull 
down process; 

Fig. 13A illustrates the HD video signal output; 

Fig. 13B illustrates conversion into a PAL signal 
through a 50 Hz-DEFT process; 

Fig. 13C illustrates conversion into a. PAL signal 
through a 50 Hz-FD process; 

Fig. 14A illustrates an HD composite video signal 
output by a compositor 54; 
[0014] 

Fig. 14B illustrates an NTSC composite video signal 

output by a compositor 57; 

Figs 15A illustrates an HD composite video signal 

output by the compositor 54; 

Fig. 15B illustrates a PAL composite signal output 

by the compositor 57; 

Fig. 16 is a flowchart of the processing steps performed 

by an output controller 51 ; 

Fig. 17 illustrates the internal structure of the 

signal output unit 28 according to a second embodiment of 

the present inventions- 
Fig. 18A illustrates the internal structure of BD.CCI 
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according to a third embodiment of the present invention; 
[0015] 

Fig. 18B illustrates the internal structure of 
CCIforPL; 

Fig . 19 illustrates the functional blocks of a playback 
device according to the third embodiment; 

Fig. 20 illustrates a flowchart of playback processing 
performed by a playback control engine 60; 

Fig. 21A illustrates the internal structure of BD.CCI 
according to a fourth embodiment of the present invention; 
[0016] 

Fig. 21B illustrates the internal structure of 
CCIforClip; 

Fig. 22 illustrates a flowchart of processing performed 
by the playback control engine 60 according to the fourth 
embodiment ; 

Fig. 23A illustrates the internal structure of BD.CCI 
according to a fifth embodiment of the present invention; 
[0017] 

Fig. 23B illustrates the internal structure of. 
CCIf orPlayltem; 

Fig. 24 illustratesa flowchart of processing performed 
by the playback control engine 60 according to the fifth 
embodiment; 

Fig. 25 illustrates the internal structure of a 
playback device according to a sixth embodiment of the 
present invention; 

Fig. 26 illustrates the internal structure of CCIforPL 



according to a seventh embodiment of the present invention; 

Fig. 27 illustrates an example setting of "CCIforHD 
with CM" and "CCIforHD without CM"; 

Fig. 28 illustrates an example setting of "CCIforSD 
5 with CM" and "CCIforSD without CM"; 

Fig. 29 illustrates copy restrictions defined with 
the use of additionally provided attributes; 

Fig. 30 illustrates an example of CM content stored 
on a local storage 32; 
10 Fig. 31A illustrates the structure of a SubClip 

constituting the CM content; 
[0018] 

Fig. 31B illustrates the internal structure of a DSU 
and a DPU included in a text subtitle substream; 
15 Fig. 32 illustrates the internal structure of PL 

. information constituting the CM content; 

Fig. 33 illustrates the internal structure of Playltem 
information illustrated in Fig. 32; 

Fig. 34 illustrates the timeline of PlayList playback 
20 defined by the PL information stored on the local storage 
32; 

Fig. 35A illustrates an example setting of the DSU 
and the DPU; 
[0019] 

25 Fig. 35B illustrates the video playback presented by 

sequentially displaying text strings at a specified 
presentation start time and at a specified position on a 
presentation graphics plane 18; 



Fig. 36 illustrates an improvement made on a playback 
device, according, a seventh embodiment of the present 
invention; 

Fig. 37A illustrates themeaning of values that PSR (23) 
may hold; 
[0020] 

Fig. 37B illustrates an example of setup menu; 

Fig. 38 illustrates a flowchart of setup processing 
performed by a setup-menu processing unit 63; 

Fig. 39 is a flowchart of processing performed by the 
playback control engine 60 according to the seventh 
embodiment; 

Fig . 4 0 illustrates a flowchart of processing performed 
for synchronous playback of the SubClip with the stream 
playback; 

Fig . 41 illustrates a flowchart of processing per formed 
for playback of SubPlayltem #y; 

Fig. 42A illustrates a video sequence presented on 
a TV without CM added thereto; 

Fig. 42B illustrates an SD video signal carrying the 
video sequence; 

Figs. 43A illustrates a video sequence presented on 
a TV with CM added thereto, and Fig. 43B illustrates an 
SD video signal carrying the video sequence: 

Fig . 4 4 A illustrates the internal structure of CCIf or PL 
according to an eighth embodiment of the present invention; 
[0021] 

Fig. 44B illustrates the internal structure of a CM 
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request that a network device 31 issues for downloading 
the CM content; 

Fig. 45 schematically illustrates acquisition of the 
Disc ID by a CPU 4 4 (*1), and the transmission of a CM request 
to a WWW server from the network device 31 (*2, and *3) ; 

Fig. 46 schematically illustrates the transmission 
of the CM content and CCI from the WWW server to the playback 

device (*3, *4, and *5');_ 

Fig. 47 illustrates the internal structure of a CM 
request according to a ninth embodiment of the present 
invention; 

Fig. 48 schematically illustrates the acquisition of 
maker information and the Disc ID (*1) as well as the 
transmission of the CM request to the WWW server from the 

network device 31 (*2 and *3); 

Fig. 49 illustrates the uses of the maker information; 

Fig. 50 illustrates the application layer format of 
the BD-ROM according to a tenth embodiment; 

Fig. 51 illustrates the structure of an AV clip 
multiplexed with a graphics stream that is used for CM 
presentation; 

Fig . 52A illustrates the content of ODS and PDS carried 
in the graphics stream used for CM presentation; 
[0022] 

Fig. 52B illustrates CCIforClip that is unique to the 
AV clip; and 

Fig . 53 illustrates a flowchart of processing performed 
by the playback control engine 60 according to an eleventh 
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embodiment of the present invention. 

Best Mode for Carrying Out the Invention 
[0023] 

5 (FIRST EMBODIMENT) 

The following describes an embodiment of a recording 
medium according to the present invention. First of all, 
among various acts of practicing the recording medium of 
the present invention, an act of using is described. Fig. 
10 1 illustrates a form of using the recording medium according 
to the present invention. In Fig. 1, a BD-ROM 100 is the 
recording medium according to the present invention. The 
- BD-ROM 100 is used to supply copyrighted material to a home 
theater system composed of a playback device 200, a remote 
15 controller 300, an SDTV 400, an HDTV 500, and a recording 
device 600 . 
[0024] 

The playback device 200 is used to play back a movie 
recorded on the BD-ROM. More specifically, the playback 

20 device 200 decodes elementary streams (video, PG, and IG 
streams ) carrying the movie recorded on the BD-ROM to output 
a video signal obtained by the decoding. The video signal 
may be an SD video signal or an HD video signal . The playback 
device has a composite terminal, analog output terminals, 

25 such as D3, D4, and D5, and a digital output terminal, such 
as HDMI . Via those terminals, the playback device is 
connected to the SDTV 400 and HDTV 500. The video signal 
output to the HDTV is also output to the recording device 
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600. 
[0025] 

The recording device 600 is used to record SD and HD 
video signals output from the playback device. The 
recording is carried out by receiving and encoding the SD 
and HD video signals and recording the encoded signals on 
a portable recording medium, such as BD-RE, DVD-RAM, DVD-R, 
DVD-fR, SD card, and removable HDD. In order that the 
recording device is permitted to record the video signal, 
the following . requirement needs to be met. That is, copy 
generation management information, such as CGMS or any other 
form of information, embedded in the SD and HD video signals 
indicates that recording of the content is permitted. In 
the case where CGMS is set to the "Never Copy" status 
prohibiting any recording, the recording device 600 does 
not perform the recording operation described above. If 
the CGMS is set to the "Only One Copy" status, recording 
of the movie is permit ted but no further generation of copying 
is possible. If the CGMS is set to "Copy Free" status, 
a copy of the content recorded on the potable media can 
be copied for unlimited number of times. 
[0026] 

Next, the following describes an act of manufacturing 
the recording media according to the present invention. 
Fig. 2 illustrates the structure of the BD-ROM that is the 
recording media according to the present invention. In 
the figure, the BD-ROM is illustrated on the fourth level, 
and the track of the BD-ROM is illustrated on the third 
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level. In the figure, the track is laterally stretched 
out, although the track in practice spirals outwards from 
the center of the BD-ROM. The track is composed of a lead-in 
area, a volume area, and a lead-out area. The volume area 
5 has a layer model of a physical layer, a file system layer, 
and an application layer. Data on the application layer 
constitutes the movie and is encrypted. A decryption key 
for decrypting the encrypted data is generated from a Disc 
ID and BD.MKB recorded in the lead-in area that is not 

10 copiable by users. Yet, any detailed description thereof 
is not. given here. Since the data on the application layer 
is encrypted using a key stored on the lead-in area, 
unauthorized copying of the data on the BD-ROM to another 
-recording medium will be of no use. 

15 [0027] 

Fig. 3 illustrates the application layer format 
(application format) of the BD-ROM expressed using a 
directory structure . Fig. 3 illustrates the structure of 
the application layer of the recording medium according 

20 to the present invention. As illustrated in the figure, 
the BD-ROM has a Root directory, and the Root directly has 
a BDMV directory. 

The BDMV directory stores a file with the extension 
"CCI" (a file called "BD.CCI") . In addition, the BDMV 

25 directory has three subdirectories called "PLAYLIST" , 
"CLIPINF", and " STREAM" . 
[0028] 

The PLAYLIST directory stores files with the extension 



"mpls" (files called "00001 . MPLS", "00002 . MPLS" , and 
"00003. MPLS") . 

The CLIPINF directory stores files with the extension 
"CLIP" (files called "00001 . CLPI", "00002 . CLPI" , and 
5 "00003. CLPI") . 

The STREAM directory stores files with the extension 
"M2TS" (files called "00001 .M2TS", "00002 . M2TS" , and 
"00003. M2TS") . 
[0029] 

10 The following sequentially describes files stored in 

- each directory. 

<Internal Structure of BD.CCI> 

Fig. 4A illustrates the internal structure ofBD.CCI. 

15 The BD-CCI contains information indicating, for each of 
a plurality of image quality levels, whether it is permitted 
to record a video signal output for playback at a respective 
image quality level. As illustrated in the figure, the 
BD-CCI includes CCIforHD defining a copy restriction of 

20 an HD video signal output and CCIforSD defining a copy 
. restriction on an SD video signal output. Fig. 4B 
illustrates one possible setting of CCIforHD. 
[0030] 

The CCIforHD is set to indicate one of the following 
25 statuses: "Copy Free", "Only One Copy", "Never Copy", and 
"EPN Copy Free". 

The "Copy Free" status indicates that it is permitted 
to record an HD video signal on a portable recording medium 
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and also permitted to freely copy the recorded content. 

The "Only One Copy" status indicates that it is 
permitted to record an HD video signal on a portable recording 
. medium. However, no further copying of the recorded content 
5 is permitted since the CCI is changed to indicate the "No 
More Copy" status upon the recording. 
[0031] 

The "Never Copy" status indicates that recording of 
an HD video signal is totally prohibited. 

10 The "EPN Copy Free (Copy Free + Encryption Plus 

Non-Assertion)" status indicates that it is permitted to 
freely copy an HD video signal on condition that encryption 
is applied. The encryption is applied in a manner that 
the content is decrypt able only within a single home network . 

15 Since such encryption is required, the content is protected 
from unauthorized distribution via the Internet, while 
ensuring user's right to freely use the content within the 
home network . 
[0032] 

20 Similarly to the CCIforHD, the CCIforSD is set to 

indicate one of the following statuses: "Copy Free", "Only 
One Copy", "Never Copy", and "EPN Copy Free". 

Since the CCIforSD is provided separately from the 
CCIforHD, different levels of restrictions can be imposed 

25 on output signals of the playback device, depending on 
whether the signals are HD or SD signals. 
[0033] 

Fig. 4C illustrates an example in which different 



levels of restrictions are imposed on recording of the 
respective levels of video signals. The copy control 
illustrated in the figure is such that an HD video signal 
is bound to the Never Copy status and an SD signal is bound 
to the Only One Copy status . Thus, it is permitted to record 
playback of the BD-ROM, provided that the playback device 
outputs the SD video signal- In this example, CCIforBD 
is set to indicate a relatively flexible copy restriction 
with CCIforSD set to the Only One Copy status. Yet, this 
is. simply an example, and the CCIforSD may be set to the 
EPN Copy Free status. 
[0034] 

This concludes the description . of the BD.CCI. 

<Structure of AV Clip> 

Next, a description is given of files with the extension 
" .M2TS" (files called "00001 .M2TS", "00002. M2TS", 
"00003 .M2TS", ...) . Fig. 5 schematically illustrates the 
structure of a file with the extension " . M2TS" . Each file 
with the extension ".M2TS" contains an AV clip. The AV 
clip ( illustrated on the middle level ) is created as follows . 
A video stream containing a plurality of video frames 

(pictures pjl, pj2, pj3, ...) and an audio stream containing 
a plurality of audio frames (both illustrated on the first 
level) are separately converted to PES packets (illustrated 
on the second level) , and further converted to TS packets 

(illustrated on the third level) . Similarly, a 
presentation graphics stream (hereinafter "PG stream") for 
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presenting subtitles and an interactive graphics stream 
(hereinafter XX IG stream") for presenting interactive 

composition (both illustrated on the first level from the 

bottom) are converted into PES packets (illustrated on the 
5 .second level from the bottom) and further into TS packets 
(illustrated on the third level from the bottom) . These 

TS packets of the video, audio, PG, and IG streams are 

multiplexed to form the AV clip. 
[0035] 

10 Before, the AV clip is recorded onto, the BD-ROM, an 

extension header is attached to each TS packet multiplexed 
in the AV clip. The extension header is 4-byte data called 
"TP_extra_header" and contains "arrival_time_stamp" and 
"copy_permission_indicator" . The TS packets each 

15 attached with a TP_extra_header are divided into groups 
of 32 packets, and each group of packets is recorded into 
three sectors of the BD-ROM track. The size of one group 
composed of 32 packets with headers amounts to 6,144 (= 
32 x 192) bytes, which is equal to the total size of three 

20 sectors (= 2048 x 3) . Each group of 32 TS packets with 
headers stored in three sectors of the BD-ROM track is 
referred to as an "Aligned # Unit" . 
[0036] 

This concludes the description of AV clips . Apart from 
25 the above-described AV clip composed of a plurality of 
elementary streams as described above, there is an AV clip 
composed of an elementary stream to be played back in 
synchronism with another elementary stream. Such an AV 



clip is referred to as a SubClip. For example, a SubClip 
may be a file containing only one of IG stream, an audio 
stream, and a text subtitle stream. This concludes the 
description of the internal structure of the AV clip. Next, 
individual elementary streams multiplexed in AV clips are 
sequentially described. 

[0037] 

<Video Stream> 

A video stream is an elementary stream generated by 
encoding video material into an MPEG2-Video format. 

There are different types of video material, such as 
"f ilm-basedmaterial", "NTSCmaterial" , and "PALmaterial", 
depending on the frame interval and the resolution. 
[0038] 

The "film-based material" refers to video of which 
frame interval is 3750 (alternatively 3753 or 3754)' clocks 
in time accuracy of 90, 000 Hz . The resolution of each frame 
is typically 1920 x 1080, 1440 * 1080, or 1280 * 720. A 
video stream generated from film-based material of 24 Hz 
is provided with PTS values set at the 37 50-clock intervals . 
Similarly, a video stream carrying film-based material of 
24 Hz is provided with PTS values at 3750-clock intervals. 
Similarly, a video stream carrying film-based material of 
23.976Hzis provided with PTS values at 37 53- or 37 54 -clock 
intervals . 
[0039] 

The "NTSC material" refers to video of which frame 
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interval is 1501 clocks (or 1502 clocks) . The resolution 
of each frame is typically 720 * 480 or 704 * 480. A video 
stream generated from NTSC material is provided with PTS 
values set at the 1501-clock (or 1502-clock) intervals, 
5 The "PAL material" refers to video of which frame 

interval is 1800 clocks. The resolution of each frame is 
typically 720 * 576 or 704 * 576. A video stream generated 
from PAL material is provided with PTS values set at the 
1800-clock intervals. This concludes the description of 
10 video streams . 
[0040] 

Because of its resolution, film-based material is 
generally referred to as HDmaterial . In addition, material 
having the same frequency as that of NTSC or PAL may be 

15 referred to as HD material if the resolution is 1280 x 720 
or higher. On the other hand, NTSC and PAL material is 
often referred to as SD material. Video signals 
representing HD material is what is referred to as an HD 
video signal above, whereas video signals representing NTSC 

20 or PAD material is what is referred to as an SD video signal 
above . 

< Audi o S t r eam> 

An audio stream is digital audio data encoded using 
25 the Dolby-AC3 or Linear-PCM codec. 

[0041] 

<PG Stream> 
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A PG stream is a graphics stream carrying graphics 
data used for presenting subtitles in a. specific language. 
There is a plurality of PG streams for a plurality of 
languages, such as English, Japanese, and French. A PG 
stream is composed of a sequence of functional segments, 
namely PCS (Presentation Control Segment), PDS (Pallet 
Definition Segment ) , WDS (Window Definition Segment) , ODS 
(Object Definition Segment), and END (END of Display Set 
Segment) . The ODS defines a graphics object used for 
presenting text subtitles. 
[0042] 

The WDS defines a rendering area for the display of 
graphics data on a screen. The PDS defines output colors 
for rendering the graphics object. The PCS defines page 
control for presentation of text subtitles. The page 
control includes Cut-In/Out, Fade-In/Out, Color Change, 
Scroll, and Wipe-In/Out. Under the page control defined 
by the PCS, it is possible to realize such a display effect 
that a set of text subtitles gradually disappears, while 
the next set of text subtitles starting to appear on the 
screen . 
[0043] 

A description of PG streams is found for example in 
the following PCT publication: WO 2004/068854 Al . 

<IG Stream> 

An IG stream is a graphics stream used for implementing 
interactive control. The interactive control defined by 
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an IG stream is compatible with interactive control 
performed by a DVD playback device . An IG stream is composed 
of a sequence of functional segments, namely ICS 
(Interactive Control Segment), PDS (Pallet Definition 
5 Segment), ODS (Object Definition Segment), and END (END 
of Display Set Segment) . The ODS defines a graphics object . 
A plurality of such graphics objects is used to render a 
button presented on an interactive display. The PDS defines 
output colors for rendering the graphics objects. The ICS 
10 defines control for changing the button state in response 
to a user operation. The ICs includes a button command 
to be executed upon receipt of a user operation for activating 
the button. 
[0044] 

15 A description of IG streams is found for example in 

the following PCT publication No. WO 2004/098193 A2 . 

This concludes the description of Main Clips. Next, 
a description of SubClips will be given . A SubClip contains 
a digital stream to be played back in synchronism with a 

20 Main Clip. Examples of such a digital stream include an 
audio stream, a graphics stream, and a text subtitle stream. 
This concludes the description of elementary streams. 

<Clip Inf ormation> 
25 Next, the following describes files with the extension 

" . CLPI" . Each file with the extension " . CLPI" ( files called 
"00001. CLPI", "00002. CLPI", "00003 . CLPI", ...) containsClip 
information. The clip information is management 



information of an individual AV clip. Fig. 6 illustrates 
the internal structure of Clip information. In the figure, 
leader , lines indicate that the internal structure of the 
Clip information is illustrated in greater detail. As 
indicated by the leader lines hnl, the clip information 
includes "program information" and x> EP_map" . The "EP_map" 
is used to access the address of an I picture. 
[0045] 

The "program information" indicates attributes of an 
individual elementary . stream multiplexed in the AV clip. 
The attributes include a video attribute, an audio attribute, 
and a graphics attribute. The video attribute includes 
material information indicating whether the video stream 
of the associated AV clip is of film-based material, NTSC 
material, or PAL material. 

The "EP_map" is a reference table used for indirect 
referencing to the address of a skip position specified 
by time information. As indicated by leader lines hn5, 
the EP_map is composed of a plurality of entries (Access 
Unit #1 Entry-Access Unit #n Entry) and the number of entries 

(Number) . 

[0046] 

As indicated by leader lines hn6, each entry includes 
the playback start time, the address (SPN) , and the size 
of the I picture associated with the entry. More 
specifically, the playback start time of the I picture is 
shown by the time stamp attached to the I picture 
(Presentation Time Stamp) . The address of the I picture 
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is expressed by a serially assigned SPN (Source Packet 
Number) . Note that the file name "XXX.CLPI" contains "XXX'' 
that is in common with the name of the AV clip associated 
with the Clip information. In the example illustrated in 
5 the figure, since the file name of the AV clip is "XXX", 
it is known that the Clip information is associated with 
the AV clip (XXX.M2TS) . This concludes the description 
of Clip information . 
[0047] 

10 Regarding video signal output, the program information 

includes "DC (Down Convert) information". The term 
"downconvert" refers to a conversion of HD material into 
an SD video signal. Leader lines hn3 in Fig. 6 indicates 
that the internal structure of DC information included in 

15 Clip information is illustrated in greater detail. As 
indicated by dotted arrows in the figure, the DC information 
includes "DC_Prohibit_Flag" and "DC_PAL" . The 
"DC_Prohibit_Flag" indicates whether it is permitted to 
downconvert the associated AV clip . The "DC_PAL" indicates 

20 a recommended conversion system for downconverting to PAL, 
provided that downconversion is permitted. This concludes 
the description of the Clip information. 

<Playlist Inf ormation> 
25 Next, the following describes files with the extension 

" .mpls" (files called "0001 .MPLS", "0002 .MPLS", 
"0003 .MPLS"...) . A file with the extension " .mpls" contains 
playList information. The playalist information defines 
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a play list using references to AV Clips . Fig. 7 illustrates 
the structure of PL information. As the leftmost block 
of the figure indicates, the playlist information includes 
"MainPath information" and "SubPath information". 
5 [0048] 

As indicated by dashed arrows mpl, the MainPath 
information (MainPath () ) is composed of a plurality of 
pieces of Playltem information (Playltem () ) . Each piece 
of Playltem information defines a playback section by 

10 specifying In_time and Out_time on one continuous AV Clip 
timeline. With the plurality of pieces of Playltem 
information, a PlayList (hereinafter also referred to as 
"PL") composed of a plurality of playback sections is defined. 
In Fig. 7, dashed arrows mp2 indicate that the internal 

15 structure of Playltem information is illustrated in greater 
detail. As illustrated, the Playltem information is 
composed of the following fields: 

"Clip_inf ormation_f ile_name" indicating the name of the 
associated AV clip; "In_time"; and "Out_time". Fig. 8 

20 .illustrates the relationship, between the AV clip and the 
PlayList information. The first level illustrates the 
timeline of the AV clip, and the second level illustrates 
the timeline of the PL. The PL information includes 
Playltem #1, #2, and #3. The In_time and the Out_time of 

25 Playltem #1, #2, and #3 define three playback sections. 
A linear sequence of the three playback sections defines 
a timeline that is different from the AV clip timeline. 
This timeline of the three playback sections is the PL 



timeline . illustrated on the second level in the figure. 
As stated above, by defining the Playltem information, a 
timeline different from the AV clip timeline is defined. 
A playback section of the AV clip defined by the Playltem 
5 information is referred to as a "MainPath" . 
[0049] 

The SubPath information (SubPathO) defines one 
continuous playback section by specifying In_time and 
Out_time on the timeline of the SubClip. Fig . 7 illustrates, 

10 as leader lines shl . indicate , the internal structure of 
SubPath information in detail . As illustrated, the SubPath 
information is composed of a plurality of pieces of 
SubPlayltem information (SubPlayltem ()). Further, as 
indicated by leader lines sh2 , the SubPlayltem information 

15 is composed of the following fields: 

"Clip_inf ormation_f ile_name" , "In_time", "Out_time", 
"sync_PlayItem_id", and xx sync_start_PTS_of _PlayI tern" . 
The "Clip_inf ormation_f ile_name", "In_time", and 
"Out_time" fields define a playback section on the SubClip 

20 timeline. The "sync_PlayI tem_id" and 

"sync_start_PTS_of_PlayItem" fields define synchronous 
playback of the playback section defined on the SubClip 
timeline with the PL timeline. According to the defined 
synchronous playback, playback proceeds synchronously on 

25 the PL timeline and the Subclip timeline. The playback 
section defined on the SubClip is referred to as "SubPath". 
[0050] . 

Fig. 9 illustrates a playback section defined on the 

25 



SubClip timeline and playback control defined for 
synchronous playback. In the figure, the first level 
illustrates the PL timeline, and the second level 
illustrates the SubClip timeline. The 

5 SubPlayltem. In_time and the SubPlayltem. Out__time indicate 
the start point and end point of the playback section, 
respectively. It is thus shown that the playback section 
is defined also on the SubClip timeline. An arrow Snl 
indicates that the Sync_PlayItem_id specifies a Playltem 
10 to be synchronously played with the playback section. An 
arrow Sn2 indicates that Sync_start_PTS_of _PlayItem 
specifies a specific point on the Playltem (Playltem #1). 
specified by the Sync_PlayI tem_id . 
[0051] 

15 The playback information on a BD-ROM can define a 

multi-angle section and a synchronous section. During 
playback of a multi-angle section, an angle change is 
possible among a plurality of AV clips. During playback 
of a synchronous section, an AV clip and a SubClip are 

20 synchronously played back. The Clip information and 
PlayList information described above is classified as 
"static scenario", because they define a PL, which is a 
statically defined playback unit. This concludes the 
description of the BD-ROM . 

25 [0052] 

Next, a description of a playback device according 
to the present invention is given. 
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<Internal Structure of Playback Device> 

Fig. 10 illustrates the internal structure of a 
playback device according to the present invention. Based 
on the internal structure illustrated in the figure, 
5 playback devices consistent with the present invention are 
industrially manufactured. The playback device of the 
present invention is roughly composed of two parts, one 
of which is a system LSI and the other is a drive device. 
By mounting those parts into a device cabinet and onto a 

10 substrate, the playback device can be manufactured 
industrially. The system LSI is an integrated circuit 
containing various processing units for implementing the 
functions of the playback device. The playback device 
manufactured in the above manner is composed of a BD drive 

15 1, a decryption unit la, an arrival time clock counter 2, 
a source de-packetizer 3, a PID filter 4, a transport buffer 
5, a multiplexed buffer 6, a elementary buffer 7, a video 
decoder 8, a re-order buffer 9, a switch 10, a video plane 
11, a transport buffer 12, a coded data buffer 13, a stream 

20 graphics processor 14, an object buffer 15, a composition 
buffer 16, a composition controller 17, a presentation 
graphics plane 18, a CLUT unit 19, a transport buffer 20, 
a coded data buffer 21, a stream graphics processor 22, 
an object buffer 23, a composition buffer 24, a composition 

25 controller 25, an interactive graphics plane 26, a CLUT 
unit 27, a signal output unit 28, a switch 29, a network 
device 31, a local storage 32, an arrival time clock counter 
33, a source de-packetizer 34, a PID filter 35, a switch 



36, a transport buff er 37 , an elementary buffer 38 , an audio 
decoder 39, a transport buffer 40, a buffer 41, a text 
subtitle decoder 42., a scenario memory 43, a CPU 44, an 
instruction ROM 45, and a PSR set 49 . Note that the internal 
structure illustrated in the figure is a decoder model based 
on the MPEG T-STD model and capable of down-converting. 
[0053] 

The BD drive 1 loads/ejects the BD-ROM and accesses 
the BD-ROM to sequentially read Aligned Units each composed 
of 32 TS packets . 

The decryption unit la reads the Disc ID and the BD.MKB 
from the lead-in area, and generates an encryption key. 
The decryption unit la decrypts the AV clip using the thus 
generated encryption key, and supplies the decrypted data 
in real time to the source de-packet izer 3. 
[0054] 

The arrival time clock counter 2 generates an arrival 
time clock using a 27 MHz crystal oscillator (27 MHz X-tal ) . 
The arrival time clock is a clock signal defining the timeline 
on which the ATS assigned to each TS packet is based. 

Once an Aligned Unit composed of 32 TS packets is read 
from the BD-ROM, the source de-packetizer 3 removes the 
TP_extra_header from each of the 32 TS packets and outputs 
the TS packets without the headers to the PID filter 4. 
The output by the source de-packetizer 3 to the PID filter 
4 is performed at the timing when the time measured by the 
arrival time clock counter 2 reaches the ATS shown by the 
TP__extra_header . Since the output to the PID filter 4 is 
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carried out in accordance with the ATS, the TS packets are 
sequentially output to the PID filter 4 in accordance with 
the time measured by the arrival time clock counter 2, 
regardless of the speed at which data is read from the BD-ROM, 
such as lx-speed or 2x-speed. 
[0055] 

The PID filter 4 judges, with reference to the PID 
attached to the .TS packets, whether the type of stream to 
which the TS packets belong is a video stream, a PG stream, 
or an IG stream. According to the judgment, the PID filter 
4 outputs the TS packets to an appropriate one of the 
transport buffers 5, 12, 20, and 37. 

The transport buffer (TB) 5 is a buffer for temporarily 
storing TS packets output from the PID filter 4, if the 
TS packets belong to a video stream. 
[0056] 

The multiplexed buffer (MB) 6 is a buffer for 
temporarily storing PES packets output from the transport 
buffer 5, in order to later output the video stream to the 
coded picture buffer 7. 

The elementary buffer (EB) 7 is a buffer for storing 
a video elementary stream. 
[0057] 

The video decoder 8 decodes individual frames contained 
in the video elementary stream at every predetermined 
decoding time (DTS) to obtain a plurality of frames and 
writes the resulting picture data on the re-order buffer 
9. 
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The re-order buffer 9 is a buffer for storing pictures 
(I picture and P picture) referenced by other pictures. 
[0058] 

The 'switch 10 performs switching between output from 
5 the video decoder 8 and output from the re-order buffer 
9, so as to reorder the presentation order of coded data 
obtained by decoding. 

The video plane 11 is used for presenting uncompressed 
picture data. A plane is a memory area of the playback 
10 device for storing a frame of pixel value data. The video 
plane 11 stores picture data at the resolution of 1920 * 
1080 and the picture data is composed of pixel values each 
expressed by 16-bit YUV values. 

The transport buff er (TB) 12 is a buff er for temporarily 
15 storing TS packets output from the PID filter 4, if the 
TS packets belong to a PG stream. 
[0059] 

The coded data buffer (CDB) 13 is a buffer for 
temporarily storing PES packets constituting a PG stream. 
20 The stream graphics processor (SPG) 14 decodes a PES 

packet containing graphics data (ODS) to obtainuncompressed 
bitmapped data expressed by index colors. The stream 
graphics processor (SPG) 14 then writes the obtained 
bitmapped data as a graphics object on the object buffer 
25 15. 

[-0060] 

The ob j ect buffer 15 holds the graphics obj ect obtained 
as a result of the decoding performed by the stream graphics 



processor 14 . 

The composition buffer 16 is memory for storing control 
information for graphics data rendering (PCS) . 

The composition controller 17 analyzes the PCS stored 
on the composition buffer 16 and executes control in 
accordance with the analytical result. 
[0061] 

The presentation graphic plane 18 is a memory area 
as large as one full screen and stores uncompressed graphics 
data worth one screen. The presentation graphic plane 18 
stores uncompressed graphics data at the resolution of 1920 
x 1080 and pixel values of the uncompressed graphics data 
are expressed using an 8-bit index colors. By converting 
the index colors with reference to a CLUT (Color Lookup 
Table) , the uncompressed graphics data stored on the. 
presentation graphics plane 18 is supplied for display. 

The CLUT unit 19 converts the index colors of the 
uncompressed graphics data stored on the presentation 
graphic plane 18 into Y, CR, and Cb values. 
[0062] 

The transport buff er (TB) 20 is a buffer for temporarily 
storing TS packets belonging to an IG stream. 

The coded data buffer (CDB) 21 is a buffer for 
temporarily storing PES packets constituting an IG stream. 

The stream graphics processor (SPG) 22 decodes a PES 
packet carrying graphics data to obtain uncompressed 
bitmapped data expressed by index colors, and writes the 
obtained bitmapped data as a graphics object on the object 
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buffer 23. 
[0063] 

The obj ect buffer 2 3 stores a plurality of uncompressed 
graphics objects obtained as a result of the decoding by 
5 the stream graphics processor 22. 

The composition buffer 24 is a buffer for storing 
control information for graphics data rendering. 

The composition controller 25 analyzes the PCS stored 
on the composition buffer 24 and executes control in 
10 accordance with the analytical result. 
[0064] 

The interactive graphics plane 26 is used for 
presenting uncompressed graphics data obtained as a result 
of the decoding by the stream graphics processor (SGP) 22. 

15 The uncompressed graphics data is written on the interactive 
graphics plane 26 at the resolution of 1920- * 1080, and 
the graphics data is composed of pixel values each expressed 
using 8-bit index colors. By converting the index colors 
with reference to the CLUT (Color Lookup Table), the 

20 uncompressed graphics data stored on the interactive 
graphics plane 26 is supplied for display. 
[0065] 

The CLUT unit 27 converts the index colors of the 
uncompressed graphics data stored on the interactive 
25 graphics plane 26 into Y, CR, and Cb values. 

The signal output unit 28 captures data from the video 
plane 11, the presentation graphics plane 18, and the 
interactive graphics plane 26 at predetermined time 

32 



intervals to generate HD and SD video signals and output 

the resulting signals simultaneously. 

[0066] 

The switch 29 selectively supplies the TS packets read 
5 from the BD-ROM or the TS packets read from the local storage 
32. to the transport buffer 20. 

The network device 31 is used to implement the 
communications functionality of the playback device . More 
specifically, the network device 31 establishes TCP 
10 connection, FTP connection, and so on, with a web site at 
an URL. 

The local storage 32 is used to store content supplied 
via various recording media and communication media. 
Content downloaded from a web site via the connection 
15 established by the network device 31 is also stored to the 
local storage 32. 
[0067] 

The source de-packetizer 34 removes the 
TP_extra_header from each TS packet constituting the AV 

20 clip read from the local storage 32 and outputs the TS packets 
without headers to the PID filter 35. The output of the 
TS packets to the PID filter 35 is carried out at the timing 
when the time measured by the arrival time clock counter 
33 reaches the ATS shown by the TP_ext ra_header . 

25 [0068] 

The PID filter 35 performs switching so as to 
selectively output the TS packets read from the local storage 
32 to an appropriate one of the IG stream decoder, the audio 



decoder , and the text subtitle decoder. 

The switch 36 issues a permission request for the TS 
packets read from the BD-ROM or from the local storage 32. 

The transport buffer (TB) 37 stores the TS packets 
belonging to an audio stream. 
[0069] 

The elementary buffer (EB) 38 stores the PES packets 
constituting the audio stream. 

The audio decoder 39 decodes the PES packets output 
from the elementary buff er 38 and outputs uncompressed audio 
data obtained by the decoding. 

The transport buffer (TB) 40 stores TS packets 
belonging to a text subtitle stream. 
[0070] 

The elementary buffer (EB) 41 stores the PES packets 
carrying the text subtitle stream. 

The text subtitle decoder 42 decodes PES packets read 
to the elementary buffer 41 and supplies the resulting data 
for presentation. More specifically, the text subtitle 
decoder 42 expands text strings contained in the text 
subtitle stream into bitmapped data, by applying font data 
separately read from the local storage 32. The resulting 
data is written on the presentation graphics plane 18. 
[0071] 

The scenario memory 43 stores current PlayList 
information and current Clip information. The current 
PlayList information used herein refers to the currently 
processed PlayList information from among a plurality of 
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pieces of PlayList information stored on the BD-ROM. The 
current Clip information used herein refers to the currently 
processed Clip information from among a plurality of pieces 
of Clip information stored on the. BD-ROM. 
5 The CPU executes software stored on the instruction 

ROM 4 5 to carry out overall control of the playback device. 
The control executed. on the .playback device dynamically 
changes in response to a user event generated upon receipt 
of a user operation and in. accordance with the values held 
10 in the PSRs of the PSR set 49. 
[0072] 

The instruction ROM 45 stores software defining 
playback control of the playback device. 

The PSR set 4 9 is a set registers provided within the 

15 playback device. The set of registers include 64 player 
status registers (PSRs) and 4 , 0 96 general-purpose registers 
(GPRs) . The 64 player status registers represent the 
current status of the playback device, including the current 
playback point . The current playback point is represented 

20 by the values of the PSR ( 5 ) -PSR ( 8 ) . Specifically, the 
PRS(8) takes on a value ranging from 0 to OxFFFFFFFF 
representing the current playback point (current PTM) on 
' the AV clip in 45 KHz time accuracy. The PSR (11) represents 
the page_id of the currently active page (current page) 

25 constituting a multi-page menu. The PSR (10) represents, 
the button in the selected state (current button) presented 
on the current page. 



[0073] 

<Internal Structure of Signal Output Unit 28> 

This concludes the description of the internal 
structure of the playback device. Next, a description of 
5 the internal structure of the signal output unit 28 is given 
in greater detail. Fig. 11 illustrates the internal 
structure of the signal output unit 28. As illustrated 
in the figure, the signal output unit 28 is composed of 
an output controller 51, an up-converters 52a, 52b, and 
10 52c, a compositors 53 and 54, a down-converters 55a, 55b, 
and 55c, and compositors 56 and 57. 
[0074] 

The output controller 51 captures the data presented 
on the video plane 11, the presentation graphics plane 18, 

15 and the interactive graphics plane 26 at predetermined time 
intervals, and overlays the captured plane images on one 
another to make final video output at the adjusted display 
rate. Fig. 12A illustrates the HD video signal output. 
.In the figure, frame images P1-P7 represent individual 

20 pictures constituting the HD video . The output controller 
51 outputs those frame images at 1/24 sec intervals. As 
a result, a progressive HD video signal is output at 1/24 
Hz. 

[0075] 

25 Other than the above . process, the display rate may 

be adjusted through 2:3 pull- down, 50Hz-DEFT, or 50Hz-FD. 
The "display rate adjustment" used herein refers to the 
process of displaying video, for example, film-based 
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material having a 24 Hz or 23.976 Hz display rate at a 
different display rate . Fig. 12B illustrates the 2:3 pull 
down conversion. In the figure, the frame images P1-P7 
are individual pictures constituting film-based material . 
5 By applying the 2:3 pull down, the film-based material is 
converted into the following five fields: Plt-Plb (the top 
and bottom fields of PI ) , P2t-P2b (the top and bottom fields 
of P2 ) , and P2t (the top field of P2 ) . The output controller 
51 outputs those frame fields at 1/59.94 sec intervals. 
10 As a result, the video signal is output at the display 
intervals compliant with the NTSC. 
[0076] 

Fig. 13A illustrates the HD video output signal . Fig. 
13B illustrates conversion into PAL signal through the 50 

15 . Hz-DEFT process. 50Hz-DEFT is a process of converting 24 
Hz video into 25 HZ. In other, words, it is a process of 
fast-forwarding the video. . More specifically, the 
conversion process is carried out by outputting the top 
and bottom fields of each picture at the intervals of 1/50 

20 sec. In Fig. 13A, frame images P1-P3 are individual 
pictures constituting film-based material. By applying 
the 50 Hz-DEFT conversion to the images P1-P3, the following 
six fields are output: Plt-Plb (the top and. bottom fields 
of PI) ; P2t-P2b (the top and bottom fields of P2) ; andP3t-P3b 

25 (the top and bottom fields of P3) . The output controller 
51 outputs those fields at 1/50 sec intervals. As a result, 
the film-based material is output as a video signal having 
display intervals compliant with the PAL. The 50 Hz-DEFT 



conversion is advantageous in that flame fluctuations are 
minimized. Yet, the 50-HZ DEFT involves disadvantage that 
audio playback rate needs to be increased with the video 
playback rate, which leads to audio distortion (highpitch) . 
5 Due to the disadvantage, the 50 Hz DEFT is not suitable 
for applications that place importance on music. 
[0077] 

Fig. 13C illustrates the conversion into a PAL signal 
through 50 Hz-FD. In the 50 Hz-FD (Field Dubbing) process, 

10 fields are duplicated ( field dubbing) at regular intervals 
to slower the playback rate in order to minimize audio 
distortion. For example, one out of every five frames is 
dabbled (i.e., two fields per second). In Fig. 13A, the 
flame images P1-P5 are individual pictures constituting 

15 film-based material . The frames P1-P5 are converted into 
the following ten fields: Plt-Pln, P2t-P2n, P3t-P3b, 
P4t-P4b, and P5t-P5b. In the 50Hz-FD process, the field 
P5t is subject to field dubbing. As a result of the field 
dubbing, the field p5t is output in duplicate, so that the 

20 video playback rate is reduced and maintained at the equal 
speed. In view of this, the 50 Hz FD is more suitable for 
applications that place importance on equal speed playback. 
This concludes the description of the output controller 
51 . 

25 [0078] 

For playback of a video stream of SD material, the 
up-converter (V-UC) 52a modifies the resolution of the 
uncompressed frame image data stored on the video plane 
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11 by enlarging the frame image data in the horizontal and 
vertical directions. For playback of a video stream of 
HD material , the up-converter 52a does not apply any 
conversion but simply passes, as its output, the 
5 uncompressed frame image data stored on the video plane 
11. The resolution of SD material is 720 * 480, whereas 
■ the resolution of HDTV is 1920 * 1080. Thus, the rescaling 
rate in the horizontal direction is 1920 pixels/720 pixels 
* 2 . 67, whereas the rescaling rate in the vertical direction 
10 is 1080 pixels/480 pixels = 2.25. In the process of 
up-conversion, an original frame image is enraged according 
to the rescaling ratios and the pixel aspect ratio (the 
length-to-width ratio of each pixel). 
[0079] 

15 For playback of a PG stream of SD material, the 

up-converter (PG-UC) 52b modifies the resolution of 
uncompressed graphics data stored on the presentation 
graphics plane 18 by enlarging in vertical and horizontal 
directions. For playback of a PG stream of HD material, 

20 the up-converter 52b does not apply any conversion but simply 
passes, as its output, the graphics data stored on the 
presentation graphics plane 18. The rescaling ratios in 
the horizontal and vertical directions of SD material are 
calculated in the same manner as that used by the up-converter 

25 52a. 

[0080] 

For playback of an IG stream of SD material, the 
up-converter (IG-UC) 52c modifies the resolution of 



uncompressed graphics data stored on the interactive 
graphics plane 2 6, by enlarging the graphics data in vertical 
and horizontal directions. For playback of an IG stream 
of HD material, the up-converter 52c does not apply any 
conversion but simply passes, as its output, the frame image 
stored on the interactive graphics plane 26 . The rescaling 
ratios in the horizontal and vertical directions of SD 
material are calculated in the same manner as that used 
by the up-converter 52a. 
[0081] 

The compositor 53 carries out signal composition during 
the frame intervals of HD video signal . More specifically, 
the compositor 53 overlays the uncompressed frame image 
stored on the video plane 11 with the uncompressed graphics 
object sorted on the presentation graphics plane 18 to make 
an interim composite image . In the interim composite image 
obtained as a result of the composition, the text subtitles 
are overlaid on the video. 
[0082] 

The compositor 5 4 carries out signal composition during 
(i) the frame intervals and (ii) vertical blanking intervals 
(VBI) of an HD video signal. More specifically, during 
(i) the frame intervals, the compositor 54 overlays the 
uncompressed graphics object stored on the interactive 
graphics plane 26 with the interim composite image (of the 
uncompressed picture data overlaid with the uncompressed 
graphics object stored on the presentation plane 18 ) output 
from the compositor 53 . During (ii) the vertical blanking 
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period, CGMS is embedded into vertical blanking intervals 
of the HD video signal. The CGMS is obtained by converting 
CCIforHD contained in CCIforBD. As a result of the 
processing by the compositor 54 , the HD video signal carries 
5 a composite image of video + subtitles + a menu in the frame 
intervals, and also carries CGMS generated from CCIforHD 
in the vertical blanking intervals . In the future, transfer 
of the video signal may be carried out via a digital I/F 
such as HDMI . In such a case, the copy control information 

10 (CGMS) may be transferred using a different scheme than 
the analog transfer scheme. Still, what is required for 
adapting such a feature technology is to simply replace 
the signal composition process during (ii) the vertical 
blanking periods with a scheme capable of transferring the 

15 copy generation management via. a digital I/F. 
[0083] 

The down-converter (V-DC) 55a modifies the resolution 
of an uncompressed frame image stored on the video plane 
11 by reducing the frame image in the vertical and horizontal 

20 directions. Yet, in the case where the target video stream 
is of SD material, the down-converter 55a does not apply 
any conversion but simply passes, as its output, the frame 
image stored on the video plane 11 . The resolution of HDTV 
is 1920 x 1080, whereas the resolution of SDTV is 720 * 

25 480. Thus, the rescaling rate in the horizontal direction 
is 720 pixels/1920 pixels = 0.375, whereas the rescaling 
rate in the vertical direction is 480 pixels/1080 pixels 
% 0.444. In the process of down-conversion, an original 



frame image is reduced according to the rescaling ratios 
and the pixel aspect ratio (the length-to-width ratio of 
each pixel ) . 
[0084] 

5 The down-converter (PG-DC) 55bmodifies the resolution 

of uncompressed graphics data stored on the presentation 
graphics plane 18 by reducing the graphics data in the 
vertical and horizontal directions . Yet, in the case where 
a target PG. stream is of SD material, the down-converter 

10 55b does not apply any conversion but simply passes, as. 
its output, the frame image stored on the presentation 
graphics plane 18. The rescaling ratios in the horizontal 
and vertical directions of HD material are calculated in 
the same manner as that used by the down-converter 55a. 

15 [0085] 

The down-converter (IG-DC) 55c modifies the resolution 
of uncompressed graphics data stored on the interactive 
graphics plane 2 6 . Yet, in the case where a target IG stream 
is of SD material, the down-converter 55c does not apply 

20 any conversion but simply passes, as its output, the frame 
image stored on the interactive graphics plane 26. The 
rescaling ratios in the horizontal and vertical directions 
of HD material are calculated in the same manner as that 
used by the down-converter 55a. 

25 [0086] 

The compositor 56 carries out signal composition during 
the field intervals of an SD video signal. More 
specifically, during the field intervals, the compositor 
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56 overlays the top or bottom field of the frame image stored 
on the video plane with a corresponding one of top and bottom 
fields of the uncompressed obj ect stored on the presentation 
graphics plane 18 to make an interim composite image. In 
the interim composite image obtained as a result of the 
composition by the compositor 56, the text subtitles are 
overlaid' on the video. 
[0087] 

The compositor 57 carries out signal-composition during 
(i) the field intervals and (ii) vertical blanking period 
of an SD video signal. More specifically, during (i) the 
field intervals , the compositor 57 overlays the top or bottom 
field of the uncompressed graphics object stored on the 
interactive graphics plane 26 with a corresponding one of 
top and bottom fields of the interim composite image (of 
the uncompressed picture data overlaid with the 
uncompressed graphics, obj ect stored on the presentation 
plane 18) output from the compositor 56. During (ii) the 
vertical blanking period,. CGMS is embedded into vertical 
blanking intervals of the SD video signal. The CGMS is 
obtained by converting CCIforSD contained in CCIforBD. As 
a result of the processing by the compositor 57, the SD 
video signal carries a composite image of video + subtitles 
+ a menu in the frame intervals, and also carries CGMS 
generated fromCCIforHD in the vertical blanking intervals . 
In the future, transfer of the video signal may be carried 
out via a digital I/F such as HDMI . In such a case, the 
copy control information (CGMS) may be transferred using 
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a different scheme than the analog transfer scheme . Still, 
what is required for adapting such a feature technology 
is to simply replace the signal composition process during 
(ii) the vertical blanking periods with a scheme capable 
5 of transferring the copy generationmanagement via a digital 
I/F. The scope of the term "assign" used in this 
specification is relatively broad and covers "embedding". 
CGMS in the vertical blanking periods of a video signal, 
as described above. 

10 

<Details of HD and SD Video Signals> 

Fig. 14A illustrates an HD composite video signal 
output from the compositor 54 . As illustrated in the figure, 
the HD video signal is composed of alternating "frame 

15 intervals" and "vertical blanking intervals" . The HD video 
signal carries frame images PI, P2, P3, P4, ... captured from 
the output controller 51 in the frame intervals. The CGMS 
embedded by the compositor 54 is carried in the vertical 
blanking intervals . . Since the CGMS embedded in the vertical 

20 blanking intervals indicate "Copy Never", even if the. 
recording device 600 is connected to the playback device, 
the recording device 600 is not permitted to record this 
HD video signal to a portable recording medium such as a 
DVD. 

25 [0088] 

Fig. 14B illustrates an SD composite video signal 
output in compliance with NTSC by the compositor 57. As' 
illustrated in the figure, the SD video signal is composed 



of alternating "field intervals" and "vertical blanking 
intervals". The field images Pit, Plb, P2t, P2b, P3t, P3b, 
P4t, P4b ... captured from the video plane 11 are carried 
in the field intervals . The CGMS embedded by the compositor 
5 57 is carried in the vertical blanking intervals. Since 
the CGMS embedded in the vertical blanking intervals 
indicate "Only One Copy"/ the recording device 600 is only 
permitted to make a first generation copy of the video signal 
onto a portable recording medium such as a DVD. Figs. 14A 
10 and 14B illustrate an example of NTSC signal, whereas Figs 
15A and 15B illustrate an example of PAL signal. 
[0089] 

The above description relates, but not limited, to 
an example of BD.CCI defining a relatively flexible 
15 restriction, with CCIforHD set to "Copy Never" and CCIforSD 
set to "Only Once Copy". Alternatively, CCIforHD may be 
set to "Copy Never" and CCIforSD may be set to EPN-Copy 
Free . 

Now, a specific description is given of implementation 
20 of the output controller 51. The output controller 51 may 
be implemented as a system LSI circuit containing a CPU 
and a program defining processing steps illustrated in Fig . 
16. Fig . 16 is a flowchart of the processing steps performed 
by the output controller 51. According to the flowchart, 
25 the output controller 51 judges, with reference to the Clip 
information, whether the resolution of the video stream 
contained in the AV clip is equal to 1920 x 1080 (Step SI) . 
According to the judgment result, either the sequence of 



Steps S2-S15 or the sequence of Steps S16-20 is selectively 
performed. 
[0090] 

Through the processing steps S2-S15, CCIforHD is 
converted into CGMS in a format suitable for the transmission 
path of video (step S2). In the case of analog output, 
for example, CCIforHD is converted into CGMS-A. The CGMS 
is embedded into the HD video signal and the resulting signal 
is output for playback ( step S3 ) . ■ Then, the SD video signal 
is output for playback (steps S4-S15).. 
[0091] 

At the time of the SD video signal output (steps S4-S15 ) , 
the output controller 51 refers to the DC_prohibit_f lag 
included in the Clip information (step S4) . If the 
DC_prohibit_f lag is set to "1" (step S4 : NO) , the processing 
is terminated without performing any further steps. On 
the other hand, if the DC_prohibit_f lag is set to "0" (step 
S4: YES), the step S5 is performed next. 

In the step S5, it is judged whether the SD video signal 
is in the NTSC system or the PAL system. If the SD video 
signal is in the NTSC system, the down-converters 55a, 55b, 
and 55c are activated (step S6) , and CCIforSD is converted 
into CGMS (step S7) . While instructing the compositor 54 
to.embed the CGMS into the NTSC signal, the output controller 
51 causes output of the NTSC signal to be started (step 
S8) . 
[0092] 

If it is judged in the step S5 that the SD video signal 
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is in the PAL system, a step S9 is performed next. In the 
step S9, it is judged whether the DC_PAL in the Clip 
information is set to either of "10" and "11". If it is 
set to either of "10" and "11" (step S9: YES), the output 
controller 51 activates the up-converters 52a, 52b, and 
52c (step S10) . At the same time, the output controller 
51 -converts" CCIfroSD into CGMS (step Sll) . While 
instructing the compositor 57 to embed the resulting CGMS 
to the SD signal, the output controller 51 executes the 
50Hz-FD process . As a result, output of the SD video signal 
starts (step S12) . 
[0093] 

If, on the other hand, the DC_PAL in the Clip information 
is set to neither of "10" nor "11", the output controller 
51 activates the down-converters 55a, 55b, and 55c (step 
S13), and converts CCIforSD to CGMS (step S14). While 
instructing the compositor 57 to embed the resulting GGMS 
to the SD signal, the output controller 51 executes the 

50 Hz-DEFT processes to start SD video signal output (step 
S15) . 

If the video stream is judged to be of SD material 
(step SI: NO), the output controller 51 causes CCIforSD 
to be converted into CGMS (stepS19) . The output controller 

51 then causes the resulting CGMS to be embed into the SD 
video and the resulting SD signal to be output (step S20) . 
In the case where the SD material is up-converted to be 
output as an HD video signal, the copy generation management 
information to be embedded in the video signal may be any 
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of CCIforHD and CCIforSD. 
[0094] 

As described above, according to the present embodiment , • 
copy control may be set so as to prohibit recording of an 
HD video signal but to permit recordingof an SD video signal . 
Since recording of an SD video signal is permitted, users 
are allowed to readily obtain a copy of a movie recorded 
at the SD level, simply by connecting the output terminal 
of the playback device to the input terminal of the recording 
device. As described above, since a copy of a certain 
quality level is readily available to users, simply by 
connecting the recording device 600 to the playback device . 
Thus, the users are discouraged to go through the troubles 
of obtaining rippers and make illegal copies. As a 
consequence, illegal copying by users is expected to be 
reduced . 

[0095] 

(SECOND EMBODIMENT) 

The first embodiment of the present invention mainly 
relates to the case where the playback device is connected 
to the TV via analog connection. A second embodiment of 
the present invention relates to the case where the playback 
device is connected to an HDTV via digital connection. 

The interface used for establishing digital connection 
is, for example, the one called HDMI (High Definition 
Multimedia Interface) . According to the second embodiment, 
the signal output unit 2 8 is provided therein with a connector 
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for' HDMI connection. 
[0096] 

Fig- 17 illustrates the internal structure of the 
signal output unit 28 according to the second embodiment. 
5 The reference numerals each associated with an asterisk 
(*1, *2, *3, and *4) represent processes performed by the 
signal output unit 28 for establishing digital connection. 
As illustrated in the figure, the signal output unit 28 
includes an HDMI connector 58 for establishing digital 

10 connection with the HDTV. In addition, the HDTV is provided 
with a component (HDMI connector 59) similar to the HDMI 
connector 58. The HDMI connector 58 carries out mutual 
authentication (*1), negotiates the output mode (*2), and 
then transfers uncompressed video data (*3) and CCI (*4) 

15 in compliance with the copyright protection system called 
HDCP. 
[0097] 

For transmitting CCI, the HDMI connector 58 passes 
either of the CCIforHD and CCIforSD depending on the type 

20 of material or the type of video signal carried on the 
transmission path. The type of video signal refers to 
either an HD or SD video signal . The type of material refers 
to either HD or SD video material. With the above 
arrangement, the playback device is allowed to output a 

25 video signal via a. digital I/F together with appropriate 
CCI. In the case of transferring an uncompressed video 
stream, the playback device transfers the uncompressed 
video stream with an appropriate one of CCIforHD and CCIforSD . 



The scope of the term "assign" used in this specification 
is relatively broad and covers "output CGMS with 
uncompressed video stream". 
[0098] 

The digital I/F is not limited to HDMI and may' 
alternatively be any other interface including IEEE1394, 
USB, and IP network. In addition, the copyright protection 
system is not limited to HDCP and may alternatively be any 
other system including DTCP and Net DRM. In practice , video 
signals and CCI are transmitted in the mode suitable to 
the I/F and copyright protection system employed. Yet, 
it still holds, regardless of whether a digital I/F or an 
analog I/F is employed, that appropriate CCI (restrictions 
imposed on recording) is selectably assigned in accordance 
with the type of the video signal and/or the material. 

[0099] 

(THIRD EMBODIMENT) 

According to the first embodiment above, a single piece 
of CCI is assigned to the entire BD-ROM. A third embodiment 
of the present invention relates to an improvement in which 
different pieces of CCI are assigned to different pieces 
of PL information. Fig. 18A illustrates the internal 
structure of BD.CCI according to the third embodiment. 

As illustrated in the figure, the BD.CCI is composed 
of CCIforPL #1-#N. Each piece of CCIforPL defines copy 
control to be effected on SD and HD video signals output 
at the time of playback of a specific piece of PL information . 
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Fig. 18B illustrates the internal structure of a piece of 
CCIforPL. As illustrated in the figure, CCIforPL is. 
composed of CCIforHD and CCIforSD. 
[0100] 

This concludes the description of the improvement on 
the recording medium according to the third embodiment. 
Now, the following describes an improvement made on the 
playback device . Fig . 19 illustrates the functional blocks 
of a playback device according to the third embodiment. 

As illustrated in the figure, the playback device 
includes a functional block called a playback control engine 
60 implemented by the CPU and a control program stored on 
the instruction ROM. 

The playback control engine 60 executes playback 
control according to PL information stored on. the scenario 
memory. 
[0101] 

By using CCIforPL that is additionally provided in 
the third embodiment, the playback control engine 60 
performs the processing steps illustrated in Fig. 20. The 
processing steps S101-S110 illustrated in Fig. 20 are 
processing steps common to other embodiments, whereas the 
steps Sill and S112 are unique to the third embodiment. 

Hereinafter, the processing steps performed by the 
playback control engine 60 are specifically described with 
reference to the flowchart illustrated in Fig. 20. 
[0102] 

Fig.. 20 illustrates the flowchart of the playback 



processing performed by the playback control engine 60. 
The playback processing mainly includes a step of 
controlling the decoder (stepS106) and a step of controlling 
the BD-ROM drive 1 or the local storage 18 (step S108). 

5 In the following description, the Playltem currently 
subject to the playback processing is referred to as Playltem 
#x. In the processing, first, the current PL information 
(.MPLS) is read (step S101) and the steps S102-S110 are. 
performed. The steps S102-S110 create a loop in which the 

10 steps S103-S110 are repeated on each piece of PI information 
included in the current PL information, until the judgment 
in the step S109 results in "YES". The Playltem subject 
to the processing steps in the loop is referred to as Playltem 
#x (PI #x) . When set to be the first Playltem in the current 

15 PL, the Playltem #x is initialized (step S102) . The 
terminal condition of the loop described above is satisfied 
when the last Playltem in the current PL is designated as 
the .Playltem #x (Step S109: YES) . If there is another 
Playltem following the Playltem #x in the current PL (Step 

20 S109, NO) , the next Playltem is designated as a new Playltem 
#x (Step S110). In the steps S103-S110 repeated in the 
loop, the following are performed. First/ Clip information 
specified by the Clip_inf ormation_f ile_name included in 
the Playltem #x is read to the scenario memory 25 (step 

25 S103) . The value held in the In_time of the Playltem #x 
is converted into the address u of an I picture, using the 
EP_map associated with the current Clip information (step 
S104). The value held in the Out_time of the Playltem #x 



is converted into the address v of an I picture, using the 
EP_map associated with the current Clip information (step 
S105) . The address of the first I picture subsequent to 
the address v is obtained, and the address immediately 
5 preceding the thus obtained address is designated as an 
address w ( step S107 ) . Finally, the playback control engine 
60 instructs the BD-ROM drove 1 or the local storage 18 
to read TS packets starting from the I picture address u 
and end at' the address w (step S108) . 
10" [0103] ' 

In the loop composed of the steps S103-S110 described 
above, each time a new piece of PL information is read, 
it is judged whether the current PL contains CCIforPL (step 
Sill). If CCIforPL is contained, the CCIforPL is set in 

15 the signal output unit 28, so that the CCIforPL will be 
used in the later processing (stepS112) . Through the above 
processing, each time a different piece of PL information 
is selected for playback, a different piece of CCI is set 
to impose a different level of restrictions on recording 

20 of the playback signal- Thus, copy control is carried out 
in more detail. 

(Fourth Embodiment) 

In the first embodiment, a single piece of CCI is 
25 assigned to the entire BD-ROM. A fourth embodiment of the 
present invention relates to an improvement in which 
different pieces of CCI are assigned to different AV clips. 
Fig. 21A illustrates the internal structure of BD.CCI 



according to the fourth embodiment. 
[0104] 

As illustrated in the figure, the BD.CCI is composed 
of a plurality of pieces of CCIforClip #1-#M. Each piece 
of CCIforClip defines restrictions to be imposed on SD and 
HD video signals output at the time of playback of a specific 
AV clip. Fig. 21B illustrates the internal structure of 
a piece of CCIforClip. As illustrated in the figure, 
CCIforClip is composed of CCIforHD and CCIforSD. By using 
CCIforClip, the playback control engine 60 according to 
the fourth embodiment performs the processing steps 
illustrated in Fig. 22. The processing steps S101-S110 
illustrated in Fig. 22 are processing steps common to the 
other embodiments , whereas the steps Sill and SI 12 are unique 
to the fourth embodiment . According to the flowchart, each 
time a new AV clip is selected for playback, it is judged 
whether the AV clip contains CCIforClip (step S113). If 
CCIforClip is contained, the CCIforClip is set in the signal 
output unit 28, so that the CCIforClip will be used in the 
later processing (stepS114) . Through the above processing, 
each time a different AV clip is selected for playback, 
a different piece of CCI is set to impose a different level 
of restrictions on recording of the playback signal . Thus, 
copy control is carried out in more detail. 

[0105] 

(Fifth Embodiment) 

In the first embodiment, a single piece of CCI is 
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assigned to the entire BD-ROM. A fifth embodiment of. the 
present invention relates to an improvement in which 
different pieces of CCI are assigned to different pieces 
of PI ay I tern information . Fig . 23A illustrates the internal 
structure of BD.CCI according to the fifth embodiment. 

As illustrated in the figure, the BD.CCI is composed 
of a plurality of pieces of CCI forPlayl tern #1-#M provided 
each of which is provided for a different one of a plurality 
pieces of PL information. Each piece of CCI forPlayl tern 
information defines restrictions to be imposed on SD and 
HD video signals output at the time of playback of a specific 
piece of Playltem information. Fig. 23B illustrates the 
internal structure of a piece of CCIf orPlayltem. As 
illustrated in the figure, CCIf orPlayltem is composed of 
CCIforHD and CCIforSD. By using CCI forPlayl tern, the 
playback control engine 60 according to the fifth embodiment 
performs the processing steps illustrated in Fig. 24. The 
processing steps S101-S110 illustrated in" Fig. 24 are 
processing steps common to the other embodiments, whereas 
the steps S116 and S117 are unique to the fifth embodiment. 
According to the f lowchart, each time a new piece of Playltem 
information is selected for playback, it is judged whether 
the Playltem information contains CCI forPlayl tern . (step 

5116) . If CCIf orPlayltem is contained, the CCI forPlayl tern 
is set in the signal output unit 28, so that the 
CCIf orPlayltem will be used in the later processing (step 

5117) . Through the above processing, each time a different 
piece of Playltem information is selected for playback, 
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different piece of CCI is set to impose a different level 
of restrictions on recording of the playback signal . Thus, 
copy control is carried out in more detail. 



5 [0106] 

(SIXTH EMBODIMENT) 

According to the first embodiment, CCI is described 
to be contained in the BD.CCI. According to an improvement 
made in a sixth embodiment of the present invention, CCI f orBD 
10 is not stored on the BD-RQM. Rather, CCIforBD is supplied 
to the signal output unit 28 from a secure memory card 61 
upon connection of the memory card 61 to the playback device . 

Fig. 25 illustrates a playback device according to 
the sixth embodiment. The playback device of the sixth 
15 embodiment is provided' with a connector. The memory card 
61 is connected to the playback device via the connector. 
[0107] 

The memory card 61 is for example a non-contact 
semiconductor memory card and includes a logic circuit and 

20 a connector. When connected to the .playback device via 
the connector, the memory card 61 carries out 
challenge-response mutual authentication with the playback 
device to mutually establish the validity of their 
identities. After successfully establishing the mutual 

25 authentication, the memory card 61 permits the playback 
device to access the nonvolatile memory. With this 
arrangement, access by an unauthorized device is prevented. 
In addition, owing to the large capacity of the nonvolatile 



memory ■ amounting 64.M bytes to 1G bytes, the memory card 
61 is suitable for storing copyrighted material. 
[0108] 

A user takes the memory card 61 to a Kiosk terminal 
5 set on a street, and connects the memory card 61 to the 
Kiosk terminal to acquire, on the memory card 61, a 
certificate issued by a film-distributing company. This 
certificate proves the user' s right to loosen the copy 
control . In the case where the local storage 32 has a secure 
10 area, it is applicable that such a certificate is acquired 
via the Internet using secure communications protocols and 
store the certificate in the secure area of the local storage 
32. 

[0109] 

15 As described above, the memory card 61 is connectable 

to the playback device via the connector. When the memory 
card 61 is connected to the playback device, the CPU 44 
according to the sixth embodiment makes an access to the 
nonvolatile memory of the memory card 61 to judge if a 

20 certificate issued by a film-distributing company is stored 
therein. If the certificate is stored, the CPU 44 passes 
either of CCIforSD and CCIforHD both of which define a 
relatively flexible restriction. In the figure, reference 
numerals each associated with a black dot (•!, *2, and #3) 

25 schematically represent the following processes performed 
upon establishing connection with the memory card 61 . That 
is, the judgment as to whether the certificate is stored 
ornot (#1) andpassingof CCI (•2or#3) . With this mechanism, 



movie distributing companies are offered the option of 
additionally selling the right for recording their movies . 
If the certificate is not stored on the memory card 61 or 
if the certificate is not an authentic one, the playback 
device passes, to the signal output unit 28, CCIforSD or 
CCIforHD- set to indicate "Never Copy". This arrangement 
prevents unauthorized recording of copyrighted material 
by a malicious user. 
[0110] 

As described above, the sixth embodiment offers movie 
distributing companies options of launching business of 
selling, apart from selling their movies, certificates 
proving the right to loosen copy control imposed on the 
movies. This will make a significant contribution to the 
movie industry. 

(Seventh Embodiment) 

According to a feature of the third embodiment, two 
different types of CCI, which are CCIforHD and CCIforSD, 
are provided. ■ According to a seventh embodiment of the 
present invention, CCIforHD and CCIforSD are each 
additionally provided with attributes. 

[0111] 

Fig. 26 illustrates the internal structure of CCIforPL 
according to the seventh . embodiment . In the figure, the 
"CCIforHD without CM" and the "CCIforSD without CM" are 
identical in substance to the CCIforHD and CCIforSD of the 
third embodiment, respectively. The "CCIforHD with CM" 
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and "CCIforSD with CM" are the CCI having new attributes. 

Because of the new attributers, the copy control, 
information requires supplemental information to be added 
to the video signal output. This embodiment is described 
using an example in which the supplemental information is 
advertisement or one ore more "Commercial Messages (CMs ) " . 
[0112] 

The "CCIforHD with CM" 'defines restrictions to be 
imposed on recording of an HD video signal output with 
addition of a CM. 

The "CCIfroHD without CM" defines restrictions to be 
imposed on recording of an HD video signal output without 
addition of a CM. 

The "CCIforSD with CM" defines restrictions to be. 
imposed on recording of an SD video signal output with 
addition of a CM. 
[0113] 

The "CCIfroSD without CM" defines restrictions to be 
imposed on recording of an SD video signal output without 
addition of a CM. 

The CM used herein refers to any form of information 
for advertising goods, events, organizations, and groups 
to the. public/ In this embodiment, the CM is a preview 
of an upcoming movie. 
[0114] 

Fig. 27 illustrates an example setting of "CCIforHD 
with CM" and "CCIforHD without CM". Fig. 28 illustrates 
an example setting of "CCIforSD with CM" and "CCIforSD 
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without CM". Any of "CCIforHD with CM", "CCIforHD without 
CM", "CCIforSD with CM", and "CCIforSD without CM" can be 
set to indicate Copy Free, Only One Copy, Never Copy, or 
EPN Copy Free. 

5 With the additionally provided attributes of "with 

CM" and "without CM", an advantageous effect is achieved 
that the CCIforHD and CCIforSD are able to define different 
restrictions on recording of a video signal depending on 
whether the video signal is output with or without addition 
• 10 of CM. 
[0115] 

Fig. 29 illustrates the copy restrictions defined with 
the use of the additionally provided attributes. 

According to the first embodiment, CCIforHD is set 

15 to the Never Copy status and CCIforSD is set to the Only 
One Copy status. According to this embodiment, CCIforHD 
having the "with CM" attribute is set to the Only One Copy 
status, and CCIforSD having the "with CM" attribute is set 
to the Copy Free status. The provision of the attribute 

20 offers users options of obtaining the right for loosening 
the restrictions imposed on recording of a video signal, 
in return for accepting CM to be added to the video playback. 
[0116] 

Now, a discussion is given about how subtitles are 
25 presented on movie playback. CM content to be attached 
to movie content is provided using a SubClip, Clip 
information, PL information stored on the local storage 
32. Fig. 30 illustrates an example of CM content stored 



on the local storage 32. As illustrated in the figure, 
the CM content is composed of a file called" "00005 .M2TS" 
containing a SubClip, a file called "00005 . CLPI" containing 
Clip information associated with the SubClip, and a file 
5 called "00005 . MPLS" containing PL information defining a 
playbackpath for synchronous playback of the SubClip stored 
on the local storage 32 with the AV clip stored on the BD-ROM. 
CCIforPL composed of CCIforHD with/without CM and CCIforSD 
with/without CM is associated with the PL information stored 
10 on the local storage 32. 
[0117] 

Fig. 31A illustrates the structure of the SubClip that 
constitutes the CM content. As illustrated in the figure, 
the SubClip is generated in the following way. First, the 

15 text subtitle stream illustrated on the first level is 
converted into PES packets ( illustrated on the second level ) , 
and the PES packets are further converted into TS packets 
(illustrated on the third level). Fig. 31B illustrates 
the internal structure of the text subtitle substream. The 

20 text subtitle stream is composed of a single "DSU 
( Dialog_Style_Unit ) " field at the top of the stream and 
a plurality of "DPU ( Dialog_Presentation_Unit ) " fields. 
The- DSU includes region information specifying a display 
region in which text subtitles are presented. More 

25 specifically, the region information includes 
"region_horizontal_position" and 
"region__vertical_position" specifying the horizontal and 
vertical positions of the display region, respectively. 
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The region information also includes "region_width" and 
"region_height" specifying the width and height of the 
display region, respectively. 
[0118] 

Each DPU includes "dialog_start_PTS" indicating the 
presentation start time of the subtitles, NX dialog_end_PTS" 
indicating the presentation end time of the subtitles, 
"region_id" uniquely specifying the display region in which 
the text subtitles are presented, and " text_string" to be 
presented as subtitles. 

Fig. 32 illustrates the internal structure of PL 
information constituting the CM content . Similarly to the 
PL information described above in the first embodiment, 
PL information constituting CM content also includes 
MainPath ( ) and SubPath ( ) . Leader lines mpl in the figure 
indicate: that the structure of the MainPath information 
is illustrated in greater detail. As indicated by the 
leader lines, the MainPath information includes one or more 
pieces of Playltem information. Leader lines mp2 in the 
figure illustrate that the structure of Playltem 
information is illustrated in greater detail . As indicated 
by the leader lines, Playltem information is composed 
"Clip_inf ormation_f ile_name", "In_time", and "Out_time" . 
Leader lines mp3 indicate that the structure of SubPath 
information is illustrated in greater detail . As indicated 
by the leader lines, the SubPath information includes one 
of more pieces of SubPlayltem information. 
[0119] 
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As described above, the PL information according to 
this embodiment is identical in internal structure to the 
PL information stored on the BD-ROM but differs in the 
following point. Unlike the PL information stored on the 
BD-ROM, the PL information of the seventh embodiment is 
capable of designating any Clip information regardless of 
whether the Clip information is stored on the BD-ROM or 
the local storage 32. The PL information stored on the 
local storage 32 can designate Clip information stored on 
the BD-ROM without specifying a full path. It is because 
the playback device recognizes all the directories and files 
on the local storage 32 and on the BD-ROM as a single virtual 
file system. Thus, Clip_inf ormation_f ile_name included 
in the Playltem information or in the SubPlayltem 
information can specify any of the AV clips stored on the 
local storage 32 and BD-ROM using a five-digit number of 
a file body containing the Clip information. The playback 
device reads the content stored on the local storage 32 
and dynamically synchronizes with the content stored on 
the BD-ROM, so that the BD-ROM content is played back in 
richer variations . 
[0120] 

In addition, the PL information of the seventh 
embodiment also differs from the PL information of the first 
embodiment in that the SubPath information included therein 
is capable of one-to-multiple synchronization. 
Specifically, "one" in the "one-to-mul tiple" refers to the 
text substream (SubClip) stored on the local storage 32, 
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whereas "multiple" refers to a plurality of pieces of 
Playltem information included in the PL information. For 
example, the PL information illustrated in Fig. 33 includes 
SubPath information defining that a single text subtitle 
5 stream is repeatedly played back in synchronism with each 
of a plurality of pieces Playltem information. 
[0121] 

Fig. 33 illustrates the internal structure of Playltem 
information illustrated in Fig. 32. Leader lines sh2 in 

10 the figure indicate that the structure of SubPlayltem 
information is illustrated in greater detail . As indicated 
• by the leader lines, the SubPlayltem information is composed 
of the following fields : "Clip__inf ormation_f ile_name" , 
"In_time", . "Out_time", "sync_PlayItem__id", and 

15 "sync_start_PTS_of_PlayItem" . Among the above fields, 
the "Clip_inf ormation_f ile_name" field is set to specify 
a file name commonly among a plurality of pieces of Playltem 
information. The "sync_PlayI tem_id" and 

"sync_start_PTS_of_PlayItem" fields, on the other hand, 

20 are set to values unique to a respective piece of Playltem 
information. 
[0122] 

Fig. 34 illustrates the timeline of PlayList playback 
defined by the PL information stored on the local storage 
25 32. In the figure, the first level illustrates the playback 
timeline of the AV clip stored on the BD-ROM. The second 
level illustrates the timeline of PlayList playback defined 
by the PL information stored on the local storage 32. As 



illustrated on the first and second levels of the figure, 
the PL information stored on the local storage 32 can be 
used to define a different timeline for playback of the 
AV clip stored on the BD-ROM. The third level illustrates 
the timeline defined for playback of SubClip stored on the 
local storage 32. The SubPlayltem. In_time. and the 
SubPlayltem. Out_time define the start and end points of 
the playback section of the SubClip. That is, the playback 
section is defined also on the SubClip timeline. Arrows 
Snl and Sn2 indicate the synchronous playback defined by 
the Sync_PlayItem_id and the sync_start_PTS_of_Play I tern 
in each SubPlayltem (SubPlayltem #1, #2) . More 
specifically, the arrow snl indicates the designation by 
SubPlayltem #1. 
[0123] 

Since the Sync_PlayI tem_id in the SubPlayltem #1 
designates Playltem #1, the SubClip stored on the local 
storage 32 is played back in synchronism with the Playltem 
#1. 

The arrow Sn2 indicates the synchronous playback 
defined by Sync_PlayI tem_id and 

sync_start_PTS_o f_PlayItem. 

Since the Sync_PlayI tem_id in the SubPlayltem #2 
designates Playltem #3, the SubClip stored on the local 
storage 32 will be played back in synchronism with the 
Playltem #1. Because of the above setting of SubPlayltem 
#1 and #2, the text subtitle stream stored on the local 
storage 32 is played back synchronously with Playltem #1 
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as well as with Playltem #2. 

As above, with the use of a plurality of pieces of 
SubPlayltem information, SubPath information can define 
playback control that a single SubClip is played back 
5 repeatedly in synchronism with each of multiple pieces of 
Playltem information. With such repetitive presentation 
of CM content to users, the CM content is likely to achieve 
high advertising effect. 
[0124] 

10 Fig. 35A illustrates an example setting of the DSU 

and the DPU. In this example, the region information #1 
included in the DSU is set to indicate a region of the 
presentation graphics plane 18, with the coordinate (xl, 
yl), the width RW, and the height RH . 

15 [0125] 

The four DPUs illustrated in Fig. 35A all specify the 
region information #1 defined in the DSU. Yet, each DPU 
designates with its dialog_s tart_PTS a different one of 
tl, t2, and t3. The text strings defined by the respective 
20 DPUs read as follows, "AAA Film Company", "Coming Soon", 
"US No. 1 Hit", and "Super 3". As a result of the above 
setting, the subtitles set by the DPUs are sequentially 
presented in synchronism with video playback. 
[0126] 

25 The PL information stored on the local storage 32 

defines synchronization of the text subtitle stream 
(SubClip) containing the DPUs illustrated in Fig. 35A, with 
the AV clip stored on the BD-ROM. Consequently, the text 



strings are sequentially presented at the specified 
presentation start time and at the specified position on 
the presentation graphics plane 18. As a result, the 
composite images as illustrated in Fig . 35B are sequentially 
5 played back. 

Since such PL information as above is stored on the 
local storage 32, a display effect is archived in which 
text subtitles are sequentially changed in synchronism with 
playback of the AV clip stored on the BD-ROM. The subtitles 

10 are, for example, commercial messages of the 
film-distributing company. By displaying such subtitles, 
playback of the PL information always involves display of 
CM. Alternatively to such a movie preview as described 
above, CM content presented according to this embodiment. 

15 maybe a so-called logo CM. A logo CM refers to a dynamically 
presented 'logo image of a film-distributing or 
film-production company. Generally, such a logo image is 
often presented at the beginning of a movie and thus well 
recognized as a house mark of the film-distributing or 

20 film-production company. 
[0127] 

As described above, on condition that a video signal 
is output with addition of a text subtitle stream, less 
strict restrictions are imposed on recording of such a video 
25 signal. That, is, users obtain the right to record a movie 
in return for viewing advertisement. In the above 
description, the CM content is, but not limited to, a text 
subtitle. Similar advertisement effect is archived by 



presenting some additional images to playback of the 
original video content. Other than text subtitles, for 
example, CM content may be a bitmap image or an animation 
sequence of bitmap images. Although no specific 
5 description of such variations of CM content is given here, 
the mechanism of presentation graphics used for presenting 
movie subtitles of BD-ROM content may be employed for CM 
presentation . 

This concludes the description of the improvement made 

10 on the recordingmediumaccording to this embodiment . Next, 
the following describes an improvement made on the playback 
device according to the present invention. Fig. 36 
illustrates the improvement made on the playback device 
according the seventh embodiment. As illustrated in the 

15 figure, the PSR set 46 includes a PSR.(23) . The PSR(23) 
indicates whether a user accepts addition of CM. 

Fig. 37A illustrates the meaning of values that the 
PSR(23) may hold. As illustrated in the figure, when set 
to xv l", the PSR (23) indicates that the user accepts addition 

20 of CM. When set to "0", the PSR (23) indicates that the 
user refuses addition of CM. 
[0128] 

In addition, the instruction ROM 45 is additionally 
provided with a setup-menu processing unit 63 as a control 
25 program for executing setup of the playback device. 

In response to a user operation made on the remote 
controller for calling a setup menu, the setup-menu 
processing unit 63 instructs the signal output unit 28 to. 



display a setup menu. In response to a user operation for 
selecting whether to accept addition of CM, the setup-menu 
processing unit 63 writes the value corresponding to the 
. user operation to the PSR(23). Fig. 37B illustrates an 
5 example of a setup menu. As illustrated in the figure, 
items selectable on the set-up menu generally include the 
following five items: viewer restriction, country/region, 
menu language, audio language, and subtitles language. In 
addition, the set-up menu in this embodiment includes the 
10 item for selecting whether to accept or refuse "CM Addition" . 
[0129] 

Fig. 38 illustrates a flowchart of the setup processing 
performed by the setup-menu processing unit 63. The 
processing steps of the flowchart are executed in response 

15 to a user operation made on the remote controller for calling 
the setup menu . According to the flowchart, the setup-menu 
processing unit 63 is placed in standby for receiving a 
user input of selecting one of the menu items for setting 
(step S81) . Upon receipt of the user input, the setup-menu 

20 processing unit 63 judges whether the selected menu item 
is the "CM addition" (step S82) . If the selected menu item 
is other than "CM addition", the setup-menu processing unit 
63 receives a user input related to the selected menu item. 
On the other hand, if the selected item is "CM addition", 

25 the setup-menu processing unit 63 receives a user input 
selecting whether to accept or refuse CM addition. If CM 
addition is selected to be "refused" (step S83, NO), the 
PSR(23) from among the plurality of PSRs of the PSR set 



4 6 is set to the value "0" indicating that CM addition is 
"refused" (step S85) . On the other hand, if CM addition 
is selected to be "accepted" (step S83, YES), the PSR(23) 
is set to "1" indicating that CM addition is "accepted" 
(step S84). This concludes the description of the 
processing steps performed by the setup-menu processing 
unit 63. 
[G130] 

Next, a description is given of the improvement made 
on the playback control engine 60 according to this 
embodiment . 

Once the PRS (23) is set to either "0"or "1" , the playback 
control engine 60 controls the compositors 54 and 57 included 
in the signal output unit 28. Under the control, at the 
time of PlayList. playback, an appropriate piece of CGMS 
is selected according to the. value held in the PSR(23) and 
the selected CGMS is embedded into the output video signal. 
More specifically, when the PSR (23) is set to "0" indicating 
that CM addition is "refused", the playback control engine 
60 instructs the signal output unit 28 to embed CGMS composed 
of "CCIforSD without CM" and "CCIforHD without CM". On 
the other hand, when the PSR(23) is set to "1" indicating 
that CM addition is "accepted", the playback control engine 
60 instructs the signal output unit 28 to embed CGMS composed 
of "CCIforSD with- CM" and "CCIforHD with CM". 
[0131] 

CGMS composed of "CCIforSD with CM" and "CCIforSD with 
CM" is embedded through the processing illustrated in Fig. 

70 



39. 

Fig . 39 is a flowchart of the processing steps performed 
by the playback control engine 60 according to the seventh 
embodiment. This flowchart is an improved version of the 
5 flowchart illustrated in Fig. 20. The improvement lies 
in a step S130 added before the step S101 . If the judgment 
in the step SI 30 results in "NO" , the same playback processing 
. as that described in the second embodiment will be executed. 
[0132] 

10 On the other hand, if the judgment in the step S130 

results in "YES", the steps S101-S110 are sequentially 
performed . The dif f erence with the processing of the second 
embodiment illustrated in Fig. 20 is found in that the steps 
Sill and S112 are replaced with steps S121 and S122, 

15 respectively. Through the above steps unique to this 
embodiment, the playback control engine 60 judges, each 
time a piece of PL information is read, whether CCIforPL 
is contained (step S121) . If CCIforPL. is contained, the 
playback control engine 60 sets the signal output unit 28 

20 so that the compositors 54 and 57 embed CGMS composed of 
"CCIforSDwithCM" and "CCI f orHD wi th CM" (stepS122) . This 
concludes the description of the PL information payback 
control. As described above, in order to synchronize CM 
content with AV clip playback, it is necessary to monitor 

25 when the current playback point reaches In_t ime and Out_time 
of the SubPlayltem. The monitoring is carried out as one 
sequence through the control of the video decoder 8, the 
stream graphics processor 14, the coded data buffer 22, 



and the text subtitle decoder 42. Fig. 40 illustrates the 
processing steps performed for controlling the video 
decoder 8, the stream graphics processor 14, the coded data 
buffer 22, and the text subtitle decoder 42 . The processing 
of this flowchart is to perform a loop composed of steps 
S132-137 after setting the current PTM to the PTS value 
of an I picture (step S138). 
[0133] 

Next, a description of the loop composed of the steps 
S132-S135 is given. In the loop, playback of the picture 
and audio located at the current PTM (step S132) and update 
of the current PTM (step S133) are repeated. The step S134 
defines the terminal condition to be met to exit form the 
loop. More specifically, the loop is terminated when it 
is judged in the step S134 that the current PTM reaches 
Out_time of the PI #x. 
[0134] 

In the step S135, it is judged whether there is 
SubPlayItem#y of which sync_PlayI tem_id specifies Play I tern 
#x. If there is such SubPlayltem #y, it is then judged 
in the step S136 whether the current PTM has reached 
sync_start_PTS_of_PlayItem of SubPlayltem #y. If the 
current PTM is reached, playback of SubPlayltem #y is 
executed in the step S137. 

Fig . 41 illustrates a flowchart of the processing steps 
performed for playback of SubPlayltem #y. 

In the step S147, Clip information that is specified 
by the Clip_inf ormation_f ile_name of SubPlayltem #y is read. 
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In the step S148, the value of In_time of SubPlayltem #y 
is converted into an address or, using the EP_map associated 
with the current Clip information. Similarly, in the step 
S149, the value of Out_time of SubPlayltem #y is converted 
5 into an address /3, using the EP_map associated with the 
current Clip information. In the step S150, the decoder 
is instructed to output SubPlayltem #y starting from a point 
specif ied by In_time and end at a point specif ied by Out_time . 
Then, the address of the first I picture after the address 

10 /3 is calculated and the address immediately before the thus 
calculated address is set as an address y ( step S151 ) . Then, 
the BD-drive 1 or the local storage 18 is instructed to 
read Subclip #z, so that a sequence of TS packets starting 
from the address a and end at the address y is read (step 

15 SI 52) . 
[0135] 

Through the above processing steps., both the MainPath 
playback and the SubPath playback are executed in 
synchronism, so that composite images as illustrated in 

20 Fig. 35B are presented. In the steps S121-S122 of the 
flowchart illustrated in Fig. 39, CCIforPL composed of 
"CCIforHD with CM" and "CCIforSD with CM" is set in the 
signal output unit. 28, so that the CCIforPL will be used 
in the later processing. As a consequence, at the time 

25 of video signal output, CGMS imposing less strict 
restrictions is embedded within the SD and HD video signals . 
[0136] 

Fig. 42A illustrates a video sequence presented on 
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a TV without CM added thereto, and Fig. 42B illustrates 
an SD video signal carrying the video sequence. As 
illustrated in Fig. 42B, the SD video signal carries, in 
the vertical blanking intervals, CGMS that indicates the 
5 Only One Copy status. Since such CGMS is embedded, the 
recording device 600 is permitted to record the SD video 
signal once and once only. 

Figs. 43A illustrates a video sequence presented on 
a TV with CM added thereto, and Fig. 43B illustrates an 

10 SD video signal carrying the video sequence . As illustrated, 
in Fig. 43B, the SD video signal carries, in the vertical 
blanking intervals, CGMS indicating the Copy Free status. 
Since such CGMS is embedded, less strict restrictions are 
imposed and the recording device 600 is permitted freely 

15 record the SD video signal. 
[0137] 

As described above, according to this embodiment, CCI 
is set to permit copying of movie content, on condition 
that CM is added to the movie content . That is, by accepting 

20 that CM is added to movie content, a user is permitted to 
freely copy the digitized movie content. Such a copy of 
the movie content may be stored on the HD recorder or home 
server. Playback of such a copy is presented with the CM 
added thereto . Thus, whenever watching the movie content, 

25 the user has no choice but to watch CM. Consequently, a 
certain level of advertising effect is expected. Since 
users are offered the right to make personal copies of movie 
content in exchange for watching CM, this form of advertising 



works with the users' consent. In other words, since the 
users are offered the choices as to whether or not to accept 
such advertising via a copy of original content, the 
advertising effect can be increased without offending the 
users. 

[0138] 

(Eighth Embodiment) 

According to the first embodiment, CM content is 
pre-recorded on a BD-ROM. An .eighth embodiment of the 
present invention relates to the case where CM content is 
downloaded from a WWW server . Fig . 4 4A illustrates CCIforPL 
included in CCIforBD associated with CM content to be 
downloaded. Fig. 44A illustrates the internal structure 
of CCIforPL according to the eighth embodiment. As 
illustrated in the figure, the CCIforPL according to the 
eighth embodiment does not contain any CCI . Instead of 
CCI, CCIforPL defines a URL indicating the address on a 
network from which CM content and CCI is to be downloaded. 

[0139] 

Since CCIforBD contains no CCI but an URL, at the time 
of video output, the network device 31 accesses the WWW 
server at the URL and downloads CM content and CCI from 
the WWW server. 

Fig. 44B illustrates the internal structure of a CM 
request that the network device 31 issues for downloading 
CM content. As illustrated in the figure, the CM request 
includes the Disc ID recorded in the lead-in area of the 
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BD-ROM. 
[0140] 

For downloading CM content, the CPU 44 instructs the 
network device 31 to issue a CM request that includes the 
Disc ID. Fig. 45 schematically illustrates acquisition 
of the Disc ID by the CPU 44 (*1), and the transmission 
of a CM request to the WWW server from the network device 
31 (*2, and *3) . In response to the CM request transmitted 
as above, the WWW server retrieves, from its own database, 
CM content associated with the received Disc ID. The WWW 
server then encrypts "CCIforSD with CM" and "CCIforHD with 
CM" using the Disc ID, and transmits the encrypted "CCIforHD 
with CM" and "CCIforSD with CM" back to the playback device 
that issued the request . Fig . 4 6 schematically illustrates 
the transmission of . the CM content and the CCI from the 
WWW server to the playback device (*3, *4, and *5) . Upon 
receipt of the CM content and the CCI, the playback device 
records the CM content to the local storage 32 and decrypts 
the "CCIforSD with CM" and "CCIforHD with CM" using the 
Disc ID to obtain the "CCIforSD with CM" and "CCIforHD with 
CM" in plaintext. 
[0141] 

As described above, according to this embodiment, CM 
content is downloaded from a WWW server and presented in 
synchronism with movie content. Thus, it is made possible 
to present to users the latest version of CM content with 
the latest version of CCI information, simply by supplying 
such CM content to a WWW server. 
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(Ninth Embodiment) 

According to the eighth embodiment, the playbackdevice 
issues, to the server/ a CM request that contains the Disc 
5 ID. According to a ninth embodiment , a CM request contains 
maker information in addition to the Disc ID. 
[0142] 

Fig. 47 illustrates the internal structure of a CM 
request according to the ninth embodiment. As illustrated 

10 in the figure, the CM request according to this embodiment 
contains maker information in addition to the Disc ID. The 
maker information is composed of a "maker ID" identifying 
themaker of the playbackdevice and a "model number' 7 assigned 
by the maker to the playback device . The maker information 

15 illustrated in the figure is stored in a secure semiconductor 
module provided within the playback device and in a 
non-rewritable state . 
[0143] 

For issuing a CM request, the CPU 44 fetches the maker 
20 information from the secure semiconductor module mentioned 
above, and instructs the network device 31 to transmit a 
CM request composed of the maker information and the Disc 
ID. Fig. 48 schematically illustrates the acquisition of 
the maker information and the Disc ID by the CPU 44 (*1) 
25 as well as the transmission of the CM request to the WWW 
server, also by the CPU 44 (*2 and *3) . Upon receipt of 
the CM request transmitted in the above manner, the WWW 
server operates just as described in the eighth embodiment. 



More specifically, the WWW server retrieves, from its own 
database, CM content associated with the received Disc ID, 
encrypts CCI using the Disc ID, and transmits the CM content 
and the encrypted CCI back to the playback device that issued 
5 the CM request. 
[0144] 

Next, the following describes the uses of maker 
information transmitted to the WWW server 700. Fig. 49 
illustrates the uses of maker information. Transmission 
10 requests similar to the one illustrated in Fig . 48 are issued 
from playback devices around the world. With reference 
to the maker information, the WWW server 700 calculates 
the number of received transmission requests separately 
for each maker. 

15 Based on the calculation result of the transmission 

requests, a film-distributing company 800 makes a judgment 
regarding the contribution of each maker to advertising 
effect having been achieved. The f ilm-distributing 
company 800 pays advertisement fees to a maker 900 in 

20 accordance with the contribution. 
[0145] 

As described above, according to this embodiment, the 
playback device transmits maker information to the WWW 
server, for acquiring CM content . This arrangement allows 
25 the film-distributing company to figure out how much each 
maker (of playback devices) contributes to the advertising 
effect. Monetary reward for such contribution would be 
new revenue that the maker can obtain by providing 
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advertisement via copies of original content. 

(Tenth Embodiment ) 

According to the seventh embodiment, CM content is 
5 stored on the local storage. According to a tenth 
embodiment of the present invention, CM content is stored 
on the BD-ROM and a permission request is issued. Fig. 
50 illustrates the application format of the BD-ROM 
according to the tenth embodiment. As illustrated in the 

10 figure, the BD-ROM stores a SubClip that constitutes CM 
content, Clip information, and PL information. Since the 
SubClip, Clip information, and PL information are stored 
on the BD-ROM, even a playback device not provided with 
a local storage is able to present playback of movie content 

15 in synchronism with CM content. When outputting playback 
of movie content with addition of CM content, the playback 
device embeds, in the HD and SD video signals, CGMS imposing 
less strict restrictions of recording of the movie content . 

20 [0146] 

(Eleventh Embodiment ) 

According to the seventh embodiment, a SubClip 
constituting CM content is stored on the BD-ROM and the 
SubClip contains text substreams . According to an eleventh 
25 embodiment of the present invention, a graphics stream is 
provided for presenting CM (hereinafter, also referred to 
as ''CM graphics stream"), and the graphics stream is 
multiplexed into an AV clip. 
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Fig. .51 illustrates the structure of the AV clip 
multiplexed with a CM graphics stream. 
[0147] 

As illustrated on the first level from the bottom, 
5 the AV clip according to this embodiment contains a CM 
graphics stream. Fig. 52A illustrates the content of ODS 
(Object Definition Segment) and PDS (Palette Definition 
Segment) carried in the CM graphics stream. The ODS 
contains run-length coded graphics data used for CM 
10 presentation. 
[0148] 

Hereinafter, a description is given of the ODS and 
the PDS from among a plurality of functional segments 
constituting the CM graphics stream. 

15 The ODS is a functional segment defining a graphics 

object used to present text strings or figures serving as 
CM. The graphics object composed of a plurality of pieces 
of run-length data. Each piece of run-length data is 
composed of a pixel code representing a pixel value and 

20 a run-length count of the pixel value. The pixel code is 
an 8-bit value showing one of the values from 1 to 255. 
■ Through the use of this pixel code, the run-length data 
sets arbitrary 256 pixel colors out of full colors 
(16,777, 216 colors) . Note that a graphic object used to 

25 present text subtitles needs to be rendered by placing a 
text string. with a transparent background color. 
[0149] 

The PDS is a functional segment that defines pallet 
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data used for color conversion. The pallet data shows 
combinations of pixel codes of 1 to 255 and pixel values. 
The pixel value used herein is made up of a red color 
difference component (Cr value), a blue color difference 
component (Cb value) , a luminance component (Y value) , and 
a transparency (T value) . Substituting a pixel code of 
each piece of run-length data into a pixel value shown by 
the palette data produces a color. 
[0150] 

For causing the CM graphics stream to be selected, 
the BD-ROM according to this embodiment stores CCI 
(CCIforClip) that is unique to this AV clip. Fig. 52B 
illustrates the CCIforClip that is unique to the AV clip. 

The "CCI for AV clip" illustrated in Fig. 52B includes 
PID that uniquely identifies the above-mentioned CM 
graphics stream (i.e. PG stream used for CM presentation) . 
At the time of playback, the playback device sets the value 
of the PID to the filter 4, so that the CM graphics stream 
is decoded and played back. Consequently, CGMS defining 
less strict restrictions is embedded in the HD and SD video, 
signals. Alternatively to PID, any information uniquely 
identifying the CM graphics stream may be used. 
[0151] 

This concludes the description of the improvement made 
on the recording medium. Now, a description is given of 
the improvement made on the playback device. In the 
flowchart illustrated in Fig. 22, the steps S113 and S114 
are unique to the processing of CCIforClip. According to 
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the eleventh embodiment/ the step S113 is modified as 
illustrated in Fig. 53. In addition, the step S114 is 
replaced by steps sl61-S164 also as illustrated in Fig. 
53. Now, a description of the steps S161-S164 is given. « 
5 [0152] 

According to the flowchart in Fig. 53, each time a 
new AV clip is selected for playback, it is judged whether 
the value held by the PSR ( 23) is "1" (step SI 61) . ThePSR(23) 
represents the setting as to whether CM presentation is 

10 permitted by the user. If set to the value "0" indicating 
that CM presentation is not accepted, the signal output 
unit 28 is set to embed "CCIforSD without CM" and "CCIforHD 
without CM" included in CCIf or PL associated with the current 
AV clip (step S162) . 

15 [0153] 

On the other hand, if thePSR(23) is set to "1" indicating 
that CM presentation is accepted, the playback device 
fetches PID from CCIforClip associated with the AV clip 
and sets the value of PID to the PID filter 4 (step S163) . 

20 As a result of this setting, during playback of the AV clip 
illustrated in Fig. 51, the CM graphics stream is selected 
by the PID filter 4 and output to the stream graphics 
processor 41. Then, the signal output unit 28 is set to 
embed "CCIforSD with CM" and "CCIforHD with CM" included 

25 in CCIf orPL associated with the current AV clip (stepS164) . 
[0154] 

As described above, according to this embodiment, a 
CM graphics stream is multiplexed with an AV clip, so that 
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the CM is presented to users when the AV clip is selected 
for playback. 

(Supplemental Note) 
5 The above description does not cover all the 

embodiments of the present invention. The present 
invention may be embodied by any embodiments including the 
following (A) to (T) below. The invention recited in each 
of the claims of this application includes extension and 

10 generalization of the above embodiments and their 
modifications below. The degree of extension and 
generalization depends upon the state of the art in the 
technical field of the present invention at the time when 
the present invention was made. 

15 ' [0155] 

(A) According to the above embodiments, the BD-ROM 
stores PG and IG streams of HD quality only. Yet, it is 
applicable that the BD-ROM also stores PG and IG streams 
separately provided for down-conversion. At the time of 

20 down-converting, the selection may be made by the playback 
device or by a user. 

(B) According to the above embodiments, a PG stream 
may be used to present text subtitles. However, the image 
quality of the PG stream may not be maintained at a 

25 satisfactory level if the PG stream is down-converted. In 
view of this, it is desirable that down-conversion is 
performed using a vector image font such as True Type font. 
[0156] 
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(C) Each of the above embodiments relates to a player 
model provided with separate converters optimum for video, 
PG, and IG streams, so as not to degrade image quality. 
Yet, it is applicable to first generate composite images 
at the HD level, and then down-convert the HD video signal 
to an SD video signal. If it is expected in this case that 
Pan & Scan should be applied to adjust the down-converted 
image into a 4:3 aspect ratio television image, the display 
region of text subtitles may be adjusted (especially, 
widthwise) so as to fit within such a 4:3 aspect ratio 
television image. 

[0157] 

(D) Although the above embodiments do not provide a 
detailed description regarding how to set the display region 
of text subtitles, the setting may be made in view of 
down-converting. More specifically, different display 
regions may be set for the letterbox of down-converted NTSC, 
Pan & Scan for down-converted NTSC, letterbox of 
down-converted PAL, and Pan & Scan for down-converted PAL. 
It is also applicable to set different display regions and 
allowing a user to arbitrary select any of the display regions 
according to the user's preference. 

[0158] 

(E) According to the first embodiment, a specific field 
is repeatedly presented at the time of down-converting 
through the field doubling process. Yet, the following 
modification may be made to reduce image fluctuations . That 
is, at the time of down-conversion by the field doubling 
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process, an interim field picture is generated from and 
insertedbetween the previous and subsequent pictures . For 
example, the secondpicture P5t of 50 Hz-FD ( PAL) illustrated 
in the figure may be generated from the pictures P5 and 
5 P6 of the 24 Hz (film). 
[0159] 

(F) The above embodiments relate to the BD-ROM and 
the playback device. Yet, it is applicable that CCIforHD 
and CCIforSD are multiplexed in a digital broadcast stream. 

10 (G) According to the above embodiments, a different 

piece of CCI is defined for a different piece of PlayList 
information. Yet, it is applicable that a different piece 
of CCI is selectable by a Java application (program or script 
for playback control). 

15 (H) It is desirable that the subtitles and the portions 

covered by the subtitles are always presented 
simultaneously. It is because such setting makes it easier 
to establish correspondence between HDTV and SDTV in the 
case of simultaneous output of the HDTV and SDTV signals. 

20 [0160] 

(I) An audio down-coverer A-DC may be connected to 
the output end of the audio decoder 39. Down sampling by 
the audio down-converter A-DC ensures audio output at the 
SDTV quality. 

25 (J) CCIforBD may contain "APSTB" . APSTB is a two-bit 

value indicating whether to apply analog protection to SD 
' video signal. When set to the value "01", APSTB indicates 
that analog protection is applied by disturbing the AGC 



circuit of VTR. When set to the value of "10", APSTB 
indicates that analog protection is applied by the AGC 
process and two-line color stripe system. When set to the 
value of "11", APSTB indicates that analog protection is 
5 appliedby the AGC process and four-line color stripe system. 
When set to the value of "00", APSTB indicates that no analog 
protection is applied. 
[0161] 

(K) The first embodiment relates to a player model 
10 based on the T-STD of MPEG-TS. Yet, the present invention 
is applicable to a player model based on the MPEG-PS or 
other multiplexing technique.. In addition, at the time 
of performing down-conversion, the playback device may 
display recommendations for down-conversion described in 
15 the Clip information and allows users to select the type 
of down-conversion. 
[0162] 

(L) As a result of the conversion of display method 
by the output control unit 51, the AV clip may be played 
20 back at a different speed than that originally defined. 
In such a case, it is not necessary that output control 
unit 51 carries out decoding at the timing specified by 
the DTS. 

(M) Each of the above embodiments relates to the case 
25 where the BD-ROM is used as the recording medium. Main 
features of the present invention, however, lie in a graphics 
stream recorded on the recording medium, which does not 
rely on physical characteristics of the BD-ROM. Therefore, 



the present invention is applicable to any recording media 
capable of recording a graphics stream. Examples of such 
recording media include: optical discs such as DVD-ROM, 
DVD-RAM, DVD-RW, DVD-R, DVD+RW, DVD+R, CD-R, and CD-RW; 
5 magneto-optical disks such as PD and MO; semiconductor 
memory cards such as CompactFlash, SmartMedia, Memory Stick, 
MultiMediaCard, and PCMCIA; magnetic disks such as flexible 
disk, SuperDisk, Zip, andClik!; removable hard disk drives 
such as ORB, Jaz, SparQ, SyJet, EZFley, and Microdrive; 
10 and built-in hard disk drives. 
[0163] 

Each of the above embodiments relates to the case where 
the playback device decodes an AV clip stored on the BD-ROM 
and outputs the decoded AV clip to the television. As an 

15 alternative, the playback apparatus may be equipped with 
a BD drive only and the remaining components are provided 
in the television. In such a case, the playback apparatus 
and the television can be incorporated in a home network 
connected with an IEEE 1394 connector. In addition, 

20 although the above embodiments relate to the case where 
the playback device is connected to the television, the 
playback device may instead be a playback device integrally 
provided with a display device. Also, the playback device 
may include only the system LSI (integrated circuit) that 

25 carries out an essential part of the processing. The 
playback apparatus and the integrated circuit are both an 
invention described in this specification. Accordingly, 
regardless of whether the playback device or the integrated 



circuit is concerned, an act of manufacturing a playback 
device based on the internal structure of the playback device 
described in the sixth embodiment is considered to be an 
act of practicing the present invention. Also, any act 
of assigning with charge (i.e. for sale) or without charge 
(i.e. as a gift), leasing, and importing the playback device 
according to the first embodiment is an act of practicing 
the present invention. Likewise, an act of offering for 
assignment or lease of the playback device using storefront 
displays, catalogs, or brochures is an act of practicing 
the present invention. 
[0164] 

(O) Information processing using the programs shown 
in the flowcharts is actually realized using hardware 
resources. Accordingly, the programs, which describe the 
processing steps shown in the flowcharts, are themselves 
an invention. The above embodiments all relate to the case 
where the programs are incorporated in the playback device, 
but the programs can be used independently of the playback 
device. Acts of practicing the programs include (1) an 
act of manufacturing, ( 2 ) an act of assigning with or without 
charge, (3) an act of leasing, (4) an act of importing, 
(5) an act of providing to the public via a bi-directional 
electronic communications network, and (6) an act of 
offering for assignment or lease using storefront displays, 
catalogs, or brochures. 

(P)* The temporal elements of the processing steps 
executed in a time series in each of the flowcharts can 
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be regarded as the necessary elements of the present 
invention . This being so, a playback method shown by these 
flowcharts is also considered to be an invention. If the 
processing shown in each flowchart is carried out by 
5 performing the processing steps in a time series so as to 
achieve the intended aim and the intended effect, it is 
considered as an act of practicing the playback method of 
the present invention. 
[0165] 

10 (Q) The above embodiments relate to the case where 

the digital stream is an AV clip of the BD-ROM format, but 
the present invention may also be embodied with a VOB (Video 
Object) of the DVD-Video Format or the DVD-Video Recording 
Format. The VOB is a program stream that complies with 

15 the ISO/IEC 13818-1 Standard and is obtainedby multiplexing 
a video stream and an audio stream. Also, the video stream 
in the AV Clip may be an MPEG4 video stream or a WMV video 
stream. Further, the audio stream in the AV clip may be 
a Linear PCM audio stream, a Dolby AC-3 audio stream, an 

20 MP3 audio stream, an MPEG-AAC audio stream, or a dts audio 
stream. 
[0166] 

(R) The movie content described in the above 
embodiments may be obtained by encoding an analog image 
25 signal broadcast by analog broadcasting. Alternatively, 
the movie content may be stream data made up of a transport 
stream broadcast by digital broadcasting. 

Alternatively, the movie content may be obtained by 
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encoding an analog/digital video signal recorded on 
videotape. Alternatively, the movie content may be 
obtained by encoding an analog/digital signal captured 
directly by a video camera. Alternatively, the video 
content may bb a digital copyrighted material distributed 
from a distribution server. 
[0167] 

(S) The CM content described in the seventh embodiment 
and onwards is visual presentation of CM. Yet, CM may be 
presented by. audio. That is, an audio stream presenting 
CM is recorded, and "CCIforSD with CM" and "CCIforHD with 
CM" may define copy control requiring the audio stream to 
be added to playback output. 

(T) The supplemental information described in the 
seventh embodiment and onwards is CM content. Yet, the 
supplemental information may present any messages or some 
kind of information other than CM. In addition, CM content 
may be for any business entity other than a film-production 
company or a film-distributing company. 

[0168] 

Industrial Applicability 

The recording medium and the playback device according 
to the present invention may be employed for personal use 
in a home theater system. Yet, the present invention may 
be manufactured in volume in accordance with the internal 
structures disclosed in the above embodiments. Thus, the 
recording medium and the playback device of the present 

90 



invention can by industrially manufactured or used on an 
industrial scale . In view of the above, the recording media 
and the playback devices of the present invention have 
industrial applicability. 
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